2024-09-10T20:54:33.256 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T20:54:33.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T20:54:33.373 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-readahead} email: hyelloji@redhat.com first_in_suite: false job_id: '7899661' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDc2YUlaaXT5euBGb+RgWSc4I1m/j98gWo5Xy28nrEjPoNx++PI03o/E7xzytFPd4WcJY/rQ3Nh/GQWDpe4eZyw= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcpGzwuRGkw16a9KscmrsDchdfsOWjie2w2AK6R7ubp5OKpS5vxwTaHVCY88SXe0J10HmKWwWAXIskwQE7NrR8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_readahead teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T20:54:33.373 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T20:54:33.373 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T20:54:33.374 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T20:54:33.375 INFO:teuthology.task.internal:Checking packages... 2024-09-10T20:54:33.395 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T20:54:33.395 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T20:54:33.395 INFO:teuthology.packaging:ref: None 2024-09-10T20:54:33.395 INFO:teuthology.packaging:tag: None 2024-09-10T20:54:33.395 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:54:33.395 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:54:33.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:54:33.547 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T20:54:33.549 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T20:54:33.558 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T20:54:33.559 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T20:54:33.572 INFO:teuthology.task.internal:Saving configuration 2024-09-10T20:54:33.587 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T20:54:33.598 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T20:54:33.631 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:49:38.368639', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDc2YUlaaXT5euBGb+RgWSc4I1m/j98gWo5Xy28nrEjPoNx++PI03o/E7xzytFPd4WcJY/rQ3Nh/GQWDpe4eZyw='} 2024-09-10T20:54:33.662 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:49:38.370043', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcpGzwuRGkw16a9KscmrsDchdfsOWjie2w2AK6R7ubp5OKpS5vxwTaHVCY88SXe0J10HmKWwWAXIskwQE7NrR8='} 2024-09-10T20:54:33.662 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T20:54:33.673 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T20:54:33.673 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T20:54:33.673 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T20:54:33.752 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7791bebbe0>, signals=[15]) 2024-09-10T20:54:33.752 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T20:54:33.763 INFO:teuthology.task.internal:Opening connections... 2024-09-10T20:54:33.763 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T20:54:33.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:54:33.867 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T20:54:33.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:54:33.949 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T20:54:33.958 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-10T20:54:33.977 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-10T20:54:33.977 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-10T20:54:34.034 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:54:34.035 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:54:34.036 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:54:34.036 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:54:34.036 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-10T20:54:34.071 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-09-10T20:54:34.089 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-09-10T20:54:34.090 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-09-10T20:54:34.148 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:54:34.149 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:54:34.149 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:54:34.149 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:54:34.149 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:54:34.149 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:54:34.149 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-09-10T20:54:34.179 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T20:54:34.190 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T20:54:34.200 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T20:54:34.201 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:54:34.203 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:54:34.220 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T20:54:34.239 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T20:54:34.240 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:54:34.261 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:54:34.352 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T20:54:34.423 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T20:54:34.447 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T20:54:34.447 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T20:54:34.447 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:54:34.448 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:54:34.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:54:34.465 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:54:34.465 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T20:54:34.465 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-10T20:54:34.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:54:34.466 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:54:34.466 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T20:54:34.467 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-09-10T20:54:34.523 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-503.el9.x86_64 2024-09-10T20:54:34.523 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:54:34.524 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T20:54:34.524 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:54:34.535 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-503.el9.x86_64 2024-09-10T20:54:34.536 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:54:34.536 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T20:54:34.536 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:54:34.677 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum upgrade -y linux-firmware 2024-09-10T20:54:34.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum upgrade -y linux-firmware 2024-09-10T20:54:36.968 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-10T20:54:37.279 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.2 MB 00:00 2024-09-10T20:54:38.872 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-10T20:54:39.038 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-10T20:54:43.128 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-10T20:54:44.281 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-10T20:54:44.578 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-10T20:54:46.066 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-10T20:54:46.515 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-10T20:54:47.794 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T20:54:51.497 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T20:54:53.191 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-10T20:54:53.597 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-10T20:54:53.598 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-10T20:54:53.598 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-10T20:54:53.709 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T20:54:53.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:54:53.863 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T20:54:53.864 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T20:54:53.867 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2024-09-10T20:54:55.289 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-09-10T20:54:55.289 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2024-09-10T20:54:55.289 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-09-10T20:54:55.411 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T20:54:55.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:54:55.564 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T20:54:55.565 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T20:54:55.567 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi130.front.sepia.ceph.com to complete... 2024-09-10T20:55:02.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10 20:55:02 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T20:55:02.512 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2024-09-10 20:55:02-- 2024-09-10T20:55:02.512 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 8.6s 2024-09-10T20:55:02.512 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 343M in 8.3s (41.2 MB/s) 2024-09-10T20:55:02.515 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T20:55:02.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T20:55:04.659 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying... ######################################## 2024-09-10T20:55:04.806 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing... ######################################## 2024-09-10T20:55:04.916 INFO:teuthology.orchestra.run.smithi100.stdout:Updating / installing... 2024-09-10T20:55:12.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10 20:55:11 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T20:55:12.000 INFO:teuthology.orchestra.run.smithi130.stderr:FINISHED --2024-09-10 20:55:11-- 2024-09-10T20:55:12.000 INFO:teuthology.orchestra.run.smithi130.stderr:Total wall clock time: 16s 2024-09-10T20:55:12.000 INFO:teuthology.orchestra.run.smithi130.stderr:Downloaded: 1 files, 343M in 16s (21.4 MB/s) 2024-09-10T20:55:12.003 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T20:55:12.003 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T20:55:12.916 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T20:55:14.151 INFO:teuthology.orchestra.run.smithi130.stdout:Verifying... ######################################## 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing... ######################################## 2024-09-10T20:55:14.431 INFO:teuthology.orchestra.run.smithi130.stdout:Updating / installing... 2024-09-10T20:55:22.442 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T20:55:52.960 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T20:55:52.960 DEBUG:teuthology.orchestra.run.smithi100:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T20:55:53.053 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T20:55:53.054 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T20:55:53.055 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T20:55:53.056 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T20:55:53.057 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T20:55:53.058 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T20:55:53.059 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T20:55:53.060 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T20:55:53.061 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T20:55:53.062 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T20:55:53.063 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T20:55:53.064 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T20:55:53.065 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T20:55:53.066 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T20:55:53.067 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T20:55:53.068 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T20:55:53.069 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T20:55:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T20:55:53.071 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T20:55:53.071 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T20:55:53.071 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T20:55:53.071 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T20:55:53.071 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T20:55:53.071 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T20:55:53.071 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T20:55:53.071 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T20:55:53.072 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T20:55:53.073 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T20:55:53.074 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T20:55:53.075 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T20:55:53.076 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T20:55:53.077 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T20:55:53.078 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T20:55:53.078 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T20:55:53.078 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T20:55:53.078 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T20:55:53.078 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T20:55:53.078 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T20:55:53.079 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T20:55:53.080 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T20:55:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T20:55:53.082 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T20:55:53.083 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T20:55:53.084 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T20:55:53.085 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T20:55:53.086 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T20:55:53.087 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T20:55:53.088 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T20:55:53.089 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T20:55:53.090 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T20:55:53.091 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T20:55:53.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T20:55:53.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T20:55:53.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T20:55:53.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T20:55:53.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T20:55:53.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T20:55:53.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T20:55:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T20:55:53.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T20:55:53.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T20:55:53.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T20:55:53.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T20:55:53.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T20:55:53.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T20:55:53.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T20:55:53.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T20:55:53.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T20:55:53.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T20:55:53.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T20:55:53.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T20:55:53.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T20:55:53.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T20:55:53.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T20:55:53.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T20:55:53.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T20:55:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T20:55:53.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T20:55:53.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T20:55:53.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T20:55:53.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T20:55:53.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T20:55:53.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T20:55:53.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T20:55:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T20:55:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T20:55:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T20:55:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T20:55:53.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T20:55:53.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T20:55:53.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T20:55:53.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T20:55:53.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T20:55:53.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T20:55:53.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T20:55:53.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T20:55:53.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T20:55:53.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T20:55:53.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T20:55:53.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T20:55:53.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T20:55:53.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T20:55:53.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T20:55:53.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T20:55:53.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T20:55:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T20:55:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T20:55:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T20:55:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T20:55:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T20:55:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T20:55:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T20:55:53.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T20:55:53.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T20:55:53.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T20:55:53.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T20:55:53.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T20:55:53.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T20:55:53.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T20:55:53.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T20:55:53.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T20:55:53.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T20:55:53.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T20:55:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T20:55:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T20:55:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T20:55:53.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T20:55:53.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T20:55:53.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T20:55:53.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T20:55:53.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T20:55:53.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T20:55:53.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T20:55:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T20:55:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T20:55:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T20:55:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T20:55:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T20:55:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T20:55:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T20:55:53.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T20:55:53.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T20:55:53.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T20:55:53.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T20:55:53.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T20:55:53.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T20:55:53.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T20:55:53.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T20:55:53.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T20:55:53.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T20:55:53.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T20:55:53.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T20:55:53.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T20:55:53.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T20:55:53.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T20:55:53.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T20:55:53.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T20:55:53.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T20:55:53.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T20:55:53.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T20:55:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T20:55:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T20:55:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T20:55:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T20:55:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T20:55:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T20:55:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T20:55:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T20:55:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T20:55:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T20:55:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T20:55:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T20:55:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T20:55:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T20:55:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T20:55:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T20:55:53.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T20:55:53.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T20:55:53.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T20:55:53.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T20:55:53.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T20:55:53.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T20:55:53.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T20:55:53.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T20:55:53.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T20:55:53.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T20:55:53.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T20:55:53.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T20:55:53.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T20:55:53.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T20:55:53.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T20:55:53.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T20:55:53.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T20:55:53.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T20:55:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T20:55:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T20:55:53.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T20:55:53.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T20:55:53.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T20:55:53.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T20:55:53.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T20:55:53.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T20:55:53.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T20:55:53.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T20:55:53.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T20:55:53.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T20:55:53.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T20:55:53.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T20:55:53.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T20:55:53.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T20:55:53.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T20:55:53.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T20:55:53.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T20:55:53.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T20:55:53.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T20:55:53.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T20:55:53.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T20:55:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T20:55:53.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T20:55:53.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T20:55:53.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T20:55:53.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T20:55:53.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T20:55:53.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T20:55:53.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T20:55:53.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T20:55:53.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T20:55:53.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T20:55:53.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T20:55:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T20:55:53.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T20:55:53.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T20:55:53.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T20:55:53.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T20:55:53.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T20:55:53.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T20:55:53.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T20:55:53.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T20:55:53.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T20:55:53.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T20:55:53.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T20:55:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T20:55:53.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T20:55:53.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T20:55:53.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T20:55:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T20:55:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T20:55:53.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T20:55:53.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T20:55:53.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T20:55:53.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T20:55:53.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T20:55:53.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T20:55:53.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T20:55:53.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T20:55:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T20:55:53.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T20:55:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T20:55:53.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T20:55:53.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T20:55:53.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T20:55:53.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T20:55:53.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T20:55:53.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T20:55:53.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T20:55:53.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T20:55:53.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T20:55:53.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T20:55:53.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T20:55:53.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:55:53.224 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:53.224 DEBUG:teuthology.orchestra.run.smithi100:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T20:55:53.247 INFO:teuthology.orchestra.run.smithi100.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T20:55:53.247 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:55:53.247 INFO:teuthology.orchestra.run.smithi100.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:55:53.248 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-09-10T20:55:53.248 INFO:teuthology.orchestra.run.smithi100.stdout:for file in vmlinuz System.map config; do 2024-09-10T20:55:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T20:55:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:55:53.248 INFO:teuthology.orchestra.run.smithi100.stdout: fi 2024-09-10T20:55:53.248 INFO:teuthology.orchestra.run.smithi100.stdout:done 2024-09-10T20:55:53.248 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:53.249 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-09-10T20:55:53.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-09-10T20:55:53.332 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-09-10T20:55:53.332 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-09-10T20:55:53.333 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-09-10T20:55:53.333 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 82.el9 2024-09-10T20:55:53.333 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-09-10T20:55:53.333 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T20:55:53.333 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-09-10T20:55:53.333 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8274670 2024-09-10T20:55:53.334 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-09-10T20:55:53.334 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T20:55:53.334 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T20:55:53.334 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T20:55:53.334 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T20:55:53.334 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-09-10T20:55:53.334 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-09-10T20:55:53.335 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T20:55:53.335 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-09-10T20:55:53.335 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-09-10T20:55:53.335 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T20:55:53.335 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T20:55:53.336 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T20:55:53.336 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T20:55:53.336 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-09-10T20:55:53.336 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T20:55:53.336 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T20:55:53.338 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T20:55:53.338 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:53.338 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T20:55:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-09-10T20:55:55.201 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T20:55:55.234 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-09-10T20:55:55.236 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-10T20:55:55.252 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.TF2ebNDKad 2024-09-10T20:55:55.252 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TF2ebNDKad 2024-09-10T20:55:55.339 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.TF2ebNDKad 2024-09-10T20:55:55.435 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.TF2ebNDKad is 6KB 2024-09-10T20:55:55.484 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.TF2ebNDKad 2024-09-10T20:55:55.499 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T20:55:55.566 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T20:55:55.567 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T20:55:55.567 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T20:55:55.567 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T20:55:55.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:55:55.735 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-09-10T20:56:02.089 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T20:56:02.090 DEBUG:teuthology.orchestra.run.smithi130:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T20:56:02.168 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:02.168 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:02.168 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:02.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:02.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T20:56:02.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T20:56:02.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T20:56:02.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T20:56:02.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T20:56:02.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T20:56:02.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T20:56:02.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T20:56:02.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T20:56:02.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T20:56:02.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T20:56:02.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T20:56:02.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T20:56:02.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T20:56:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T20:56:02.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T20:56:02.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T20:56:02.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T20:56:02.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T20:56:02.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T20:56:02.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T20:56:02.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T20:56:02.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T20:56:02.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T20:56:02.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T20:56:02.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T20:56:02.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T20:56:02.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T20:56:02.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T20:56:02.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T20:56:02.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T20:56:02.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T20:56:02.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T20:56:02.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T20:56:02.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T20:56:02.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T20:56:02.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T20:56:02.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T20:56:02.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T20:56:02.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T20:56:02.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T20:56:02.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T20:56:02.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T20:56:02.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T20:56:02.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T20:56:02.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T20:56:02.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T20:56:02.188 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T20:56:02.188 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T20:56:02.188 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T20:56:02.188 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T20:56:02.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T20:56:02.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T20:56:02.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T20:56:02.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T20:56:02.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T20:56:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T20:56:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T20:56:02.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T20:56:02.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T20:56:02.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T20:56:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T20:56:02.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T20:56:02.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T20:56:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T20:56:02.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T20:56:02.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T20:56:02.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T20:56:02.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T20:56:02.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T20:56:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T20:56:02.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T20:56:02.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T20:56:02.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T20:56:02.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T20:56:02.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T20:56:02.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T20:56:02.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T20:56:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T20:56:02.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T20:56:02.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T20:56:02.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T20:56:02.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T20:56:02.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T20:56:02.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T20:56:02.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T20:56:02.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T20:56:02.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T20:56:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T20:56:02.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T20:56:02.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T20:56:02.226 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T20:56:02.226 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T20:56:02.226 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T20:56:02.227 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T20:56:02.227 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T20:56:02.227 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T20:56:02.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T20:56:02.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T20:56:02.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T20:56:02.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T20:56:02.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T20:56:02.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T20:56:02.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T20:56:02.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T20:56:02.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T20:56:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T20:56:02.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T20:56:02.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T20:56:02.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T20:56:02.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T20:56:02.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T20:56:02.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T20:56:02.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T20:56:02.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T20:56:02.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T20:56:02.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T20:56:02.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T20:56:02.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T20:56:02.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T20:56:02.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T20:56:02.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T20:56:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T20:56:02.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T20:56:02.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T20:56:02.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T20:56:02.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T20:56:02.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T20:56:02.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T20:56:02.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T20:56:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T20:56:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T20:56:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T20:56:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T20:56:02.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T20:56:02.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T20:56:02.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T20:56:02.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T20:56:02.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T20:56:02.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T20:56:02.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T20:56:02.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T20:56:02.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T20:56:02.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T20:56:02.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T20:56:02.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T20:56:02.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T20:56:02.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T20:56:02.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T20:56:02.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T20:56:02.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T20:56:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T20:56:02.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T20:56:02.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T20:56:02.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T20:56:02.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T20:56:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T20:56:02.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T20:56:02.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T20:56:02.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T20:56:02.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T20:56:02.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T20:56:02.282 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T20:56:02.283 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T20:56:02.284 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T20:56:02.284 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T20:56:02.284 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T20:56:02.285 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T20:56:02.286 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T20:56:02.287 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T20:56:02.288 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T20:56:02.289 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T20:56:02.290 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T20:56:02.291 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T20:56:02.292 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T20:56:02.293 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T20:56:02.294 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T20:56:02.295 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T20:56:02.296 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T20:56:02.297 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T20:56:02.298 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T20:56:02.299 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T20:56:02.300 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T20:56:02.301 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T20:56:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T20:56:02.303 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T20:56:02.304 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T20:56:02.305 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T20:56:02.306 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T20:56:02.307 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T20:56:02.308 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T20:56:02.309 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T20:56:02.310 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T20:56:02.311 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T20:56:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T20:56:02.313 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T20:56:02.314 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T20:56:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T20:56:02.316 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T20:56:02.317 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T20:56:02.318 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T20:56:02.319 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T20:56:02.320 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T20:56:02.321 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T20:56:02.322 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T20:56:02.323 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T20:56:02.323 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T20:56:02.323 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T20:56:02.323 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T20:56:02.323 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T20:56:02.323 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:56:02.326 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:02.327 DEBUG:teuthology.orchestra.run.smithi130:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T20:56:02.350 INFO:teuthology.orchestra.run.smithi130.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T20:56:02.350 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:56:02.350 INFO:teuthology.orchestra.run.smithi130.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout:for file in vmlinuz System.map config; do 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout: fi 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout:done 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T20:56:02.351 INFO:teuthology.orchestra.run.smithi130.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:02.352 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2024-09-10T20:56:02.352 INFO:teuthology.orchestra.run.smithi130.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T20:56:02.352 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:56:02.352 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:02.352 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2024-09-10T20:56:02.353 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.06 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 82.el9 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:Group : Unspecified 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 8274670 2024-09-10T20:56:02.438 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : builder@centos.org 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2024-09-10T20:56:02.439 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T20:56:02.440 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T20:56:02.440 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T20:56:02.440 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:02.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T20:56:02.985 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-09-10T20:56:04.382 INFO:teuthology.orchestra.run.smithi130.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T20:56:04.404 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-09-10T20:56:04.406 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-09-10T20:56:04.421 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.zPvqBzfMwf 2024-09-10T20:56:04.421 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zPvqBzfMwf 2024-09-10T20:56:04.488 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.zPvqBzfMwf 2024-09-10T20:56:04.628 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.zPvqBzfMwf is 6KB 2024-09-10T20:56:04.675 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.zPvqBzfMwf 2024-09-10T20:56:04.690 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T20:56:04.752 INFO:teuthology.orchestra.run.smithi130.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T20:56:04.752 INFO:teuthology.orchestra.run.smithi130.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T20:56:04.752 INFO:teuthology.orchestra.run.smithi130.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T20:56:04.752 INFO:teuthology.orchestra.run.smithi130.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T20:56:04.753 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:56:04.906 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2024-09-10T20:56:25.757 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T20:56:25.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T20:56:25.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:56:34.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T20:56:34.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-10T20:56:34.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:56:44.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-10T20:56:53.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T20:56:53.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:56:53.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-09-10T20:56:56.193 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-10T20:57:02.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-10T20:57:02.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:57:08.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T20:57:08.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:57:26.589 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-10T20:57:41.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T20:57:41.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:57:42.044 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-10T20:57:42.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T20:57:42.570 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T20:57:42.571 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-10T20:57:42.605 INFO:teuthology.orchestra.run.smithi100.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:57:42.606 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:57:42.606 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T20:57:42.606 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T20:57:43.606 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T20:57:43.607 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T20:57:43.716 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2024-09-10T20:57:43.752 DEBUG:teuthology.parallel:result is None 2024-09-10T20:58:02.321 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T20:58:14.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-10T20:58:14.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:58:14.702 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-09-10T20:58:15.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-10T20:58:15.195 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T20:58:15.195 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-09-10T20:58:15.229 INFO:teuthology.orchestra.run.smithi130.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:58:15.229 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:58:15.229 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T20:58:15.229 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T20:58:16.230 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T20:58:16.231 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T20:58:16.362 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2024-09-10T20:58:16.403 DEBUG:teuthology.parallel:result is None 2024-09-10T20:58:16.403 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T20:58:16.410 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T20:58:16.410 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:58:16.416 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:58:16.452 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T20:58:16.459 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T20:58:16.483 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T20:58:16.483 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:58:16.496 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:58:16.552 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T20:58:16.559 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T20:58:16.560 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:58:16.564 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:58:16.632 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:16.644 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:16.655 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:16.666 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:16.670 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T20:58:16.677 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T20:58:16.677 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:58:16.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:58:16.736 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T20:58:16.746 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T20:58:16.746 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:58:16.749 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:58:16.783 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:16.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:16.994 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:17.065 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:17.126 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T20:58:17.127 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:58:17.180 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:17.255 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:17.348 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:17.419 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:17.482 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T20:58:17.482 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:58:17.536 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-10T20:58:17.540 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-09-10T20:58:17.625 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:58:17.660 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:58:17.958 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T20:58:17.967 INFO:teuthology.task.internal:Starting timer... 2024-09-10T20:58:17.967 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T20:58:17.982 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T20:58:17.992 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-10T20:58:18.094 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-10T20:58:18.097 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2024-09-10T20:58:18.182 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2024-09-10T20:58:18.185 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T20:58:18.185 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-10T20:58:18.237 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-10T20:58:18.237 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2024-09-10T20:58:18.285 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2024-09-10T20:58:18.285 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2024-09-10T20:58:18.285 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:58:18.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:58:18.346 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:58:18.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:58:18.404 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T20:58:18.404 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:58:18.471 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:58:18.529 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T20:58:18.538 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T20:58:18.550 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T20:58:18.551 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T21:02:56.640 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2024-09-10T21:02:56.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T21:02:56.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:02:56.742 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-10T21:02:56.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T21:02:56.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-10T21:02:56.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:02:56.954 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-09-10T21:02:57.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-10T21:02:57.071 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T21:02:57.082 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T21:02:57.082 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T21:02:57.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:02:57.087 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T21:02:57.087 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:02:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T21:02:57.173 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T21:02:57.174 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T21:02:57.206 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T21:02:57.226 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-10T21:02:57.249 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-10T21:02:57.260 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2024-09-10T21:02:57.279 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T21:02:57.285 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2024-09-10T21:02:57.308 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T21:02:57.314 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T21:02:57.343 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T21:02:57.405 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:02:57.412 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:02:57.412 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-10T21:02:57.413 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:57.413 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:57.413 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:57.413 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:57.444 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:02:57.451 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:02:57.451 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-09-10T21:02:57.451 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:57.451 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:57.452 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:57.452 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:57.452 INFO:teuthology.run_tasks:Running task install... 2024-09-10T21:02:57.463 DEBUG:teuthology.task.install:project ceph 2024-09-10T21:02:57.463 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T21:02:57.463 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T21:02:57.463 INFO:teuthology.task.install:Using flavor: default 2024-09-10T21:02:57.469 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T21:02:57.469 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T21:02:57.470 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T21:02:57.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:02:57.472 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T21:02:57.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:02:57.626 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T21:02:57.626 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T21:02:57.637 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T21:02:57.638 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T21:02:57.805 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T21:02:57.806 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:02:57.806 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T21:02:57.835 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T21:02:57.835 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:02:57.835 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T21:02:57.875 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T21:02:57.876 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T21:02:57.892 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T21:02:57.892 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T21:02:57.974 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T21:02:57.990 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T21:02:58.052 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T21:02:58.067 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T21:02:58.107 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-10T21:02:58.110 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-10T21:02:58.122 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2024-09-10T21:02:58.125 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2024-09-10T21:02:58.382 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-10T21:02:58.416 INFO:teuthology.orchestra.run.smithi130.stdout:45 files removed 2024-09-10T21:02:58.417 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T21:02:58.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T21:02:59.450 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 131 kB/s | 84 kB 00:00 2024-09-10T21:02:59.526 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 123 kB/s | 84 kB 00:00 2024-09-10T21:03:00.159 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 36 kB/s | 24 kB 00:00 2024-09-10T21:03:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 36 kB/s | 24 kB 00:00 2024-09-10T21:03:00.759 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-09-10T21:03:00.827 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-09-10T21:03:01.421 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-10T21:03:02.218 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.2 MB 00:01 2024-09-10T21:03:07.078 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-10T21:03:07.794 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-10T21:03:12.361 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T21:03:13.003 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-10T21:03:13.961 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-10T21:03:15.216 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T21:03:15.345 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-10T21:03:16.741 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T21:03:21.646 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T21:03:23.138 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-10T21:03:24.151 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:03:24.151 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:03:24.163 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T21:03:24.164 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T21:03:24.165 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T21:03:24.166 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T21:03:24.168 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T21:03:24.170 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T21:03:24.171 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T21:03:24.236 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-10T21:03:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-10T21:03:24.260 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-10T21:03:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T21:03:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T21:03:24.262 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T21:03:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T21:03:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T21:03:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T21:03:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T21:03:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T21:03:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T21:03:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T21:03:24.263 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T21:03:24.264 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T21:03:24.265 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T21:03:24.266 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T21:03:24.267 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T21:03:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T21:03:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T21:03:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T21:03:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T21:03:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T21:03:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T21:03:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T21:03:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T21:03:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T21:03:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T21:03:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T21:03:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T21:03:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T21:03:24.270 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T21:03:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T21:03:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T21:03:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T21:03:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T21:03:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T21:03:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T21:03:24.271 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T21:03:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T21:03:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T21:03:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T21:03:24.272 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T21:03:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T21:03:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T21:03:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T21:03:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T21:03:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T21:03:24.273 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T21:03:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T21:03:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T21:03:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T21:03:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T21:03:24.274 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T21:03:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T21:03:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T21:03:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T21:03:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T21:03:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T21:03:24.275 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T21:03:24.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T21:03:24.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T21:03:24.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T21:03:24.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T21:03:24.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T21:03:24.276 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T21:03:24.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T21:03:24.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T21:03:24.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T21:03:24.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T21:03:24.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T21:03:24.277 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T21:03:24.278 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T21:03:24.278 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T21:03:24.278 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T21:03:24.278 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T21:03:24.278 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T21:03:24.278 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T21:03:24.279 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T21:03:24.279 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T21:03:24.279 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-10T21:03:24.279 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T21:03:24.279 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:03:24.280 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-10T21:03:24.280 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-10T21:03:24.280 INFO:teuthology.orchestra.run.smithi100.stdout:Install 149 Packages 2024-09-10T21:03:24.280 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-09-10T21:03:24.280 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:03:24.281 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 240 M 2024-09-10T21:03:24.281 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-10T21:03:25.214 INFO:teuthology.orchestra.run.smithi100.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-10T21:03:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.8 MB/s | 900 kB 00:00 2024-09-10T21:03:25.506 INFO:teuthology.orchestra.run.smithi100.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.3 MB/s | 145 kB 00:00 2024-09-10T21:03:25.598 INFO:teuthology.orchestra.run.smithi100.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-10T21:03:25.642 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:03:25.643 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:03:25.654 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T21:03:25.655 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T21:03:25.656 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T21:03:25.657 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T21:03:25.658 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T21:03:25.661 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T21:03:25.661 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T21:03:25.682 INFO:teuthology.orchestra.run.smithi100.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-10T21:03:25.726 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-09-10T21:03:25.732 INFO:teuthology.orchestra.run.smithi100.stdout:(6/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-10T21:03:25.742 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-09-10T21:03:25.742 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2024-09-10T21:03:25.742 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-09-10T21:03:25.742 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-09-10T21:03:25.742 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T21:03:25.742 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T21:03:25.743 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T21:03:25.744 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T21:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T21:03:25.746 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T21:03:25.747 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:03:25.748 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T21:03:25.749 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T21:03:25.750 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T21:03:25.751 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T21:03:25.752 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T21:03:25.753 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T21:03:25.754 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout:Install 149 Packages 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 8 Packages 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:03:25.755 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 240 M 2024-09-10T21:03:25.756 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-09-10T21:03:25.932 INFO:teuthology.orchestra.run.smithi100.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 19 MB/s | 4.8 MB 00:00 2024-09-10T21:03:26.340 INFO:teuthology.orchestra.run.smithi130.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-09-10T21:03:26.424 INFO:teuthology.orchestra.run.smithi100.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 16 MB/s | 22 MB 00:01 2024-09-10T21:03:26.475 INFO:teuthology.orchestra.run.smithi100.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 504 kB/s | 25 kB 00:00 2024-09-10T21:03:26.573 INFO:teuthology.orchestra.run.smithi130.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-10T21:03:26.674 INFO:teuthology.orchestra.run.smithi130.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.4 MB/s | 145 kB 00:00 2024-09-10T21:03:26.749 INFO:teuthology.orchestra.run.smithi130.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 9.0 MB/s | 5.5 MB 00:00 2024-09-10T21:03:26.874 INFO:teuthology.orchestra.run.smithi130.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-10T21:03:26.908 INFO:teuthology.orchestra.run.smithi100.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 11 MB/s | 11 MB 00:00 2024-09-10T21:03:26.949 INFO:teuthology.orchestra.run.smithi130.stdout:(6/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 2.4 MB 00:00 2024-09-10T21:03:27.109 INFO:teuthology.orchestra.run.smithi100.stdout:(11/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 12 MB/s | 17 MB 00:01 2024-09-10T21:03:27.116 INFO:teuthology.orchestra.run.smithi130.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 20 MB/s | 4.8 MB 00:00 2024-09-10T21:03:27.133 INFO:teuthology.orchestra.run.smithi100.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.0 MB/s | 225 kB 00:00 2024-09-10T21:03:27.167 INFO:teuthology.orchestra.run.smithi100.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 466 kB/s | 27 kB 00:00 2024-09-10T21:03:27.234 INFO:teuthology.orchestra.run.smithi100.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 317 kB/s | 32 kB 00:00 2024-09-10T21:03:27.418 INFO:teuthology.orchestra.run.smithi100.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 2.9 MB/s | 755 kB 00:00 2024-09-10T21:03:27.518 INFO:teuthology.orchestra.run.smithi100.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.2 MB/s | 127 kB 00:00 2024-09-10T21:03:27.635 INFO:teuthology.orchestra.run.smithi100.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 4.2 MB/s | 507 kB 00:00 2024-09-10T21:03:27.775 INFO:teuthology.orchestra.run.smithi130.stdout:(8/157): ceph-radosgw-19.3.0-4854.g8f219c47.el9 17 MB/s | 11 MB 00:00 2024-09-10T21:03:27.802 INFO:teuthology.orchestra.run.smithi100.stdout:(18/157): libcephsqlite-19.3.0-4854.g8f219c47.e 285 kB/s | 162 kB 00:00 2024-09-10T21:03:27.867 INFO:teuthology.orchestra.run.smithi130.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 276 kB/s | 25 kB 00:00 2024-09-10T21:03:27.877 INFO:teuthology.orchestra.run.smithi100.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 602 kB/s | 45 kB 00:00 2024-09-10T21:03:27.978 INFO:teuthology.orchestra.run.smithi100.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.4 MB/s | 143 kB 00:00 2024-09-10T21:03:28.086 INFO:teuthology.orchestra.run.smithi100.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.5 MB/s | 161 kB 00:00 2024-09-10T21:03:28.203 INFO:teuthology.orchestra.run.smithi100.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 9.7 MB/s | 5.5 MB 00:00 2024-09-10T21:03:28.229 INFO:teuthology.orchestra.run.smithi100.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 2.2 MB/s | 321 kB 00:00 2024-09-10T21:03:28.287 INFO:teuthology.orchestra.run.smithi100.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.6 MB/s | 306 kB 00:00 2024-09-10T21:03:28.313 INFO:teuthology.orchestra.run.smithi100.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.2 MB/s | 99 kB 00:00 2024-09-10T21:03:28.355 INFO:teuthology.orchestra.run.smithi100.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-10T21:03:28.417 INFO:teuthology.orchestra.run.smithi130.stdout:(10/157): ceph-common-19.3.0-4854.g8f219c47.el9 9.5 MB/s | 22 MB 00:02 2024-09-10T21:03:28.421 INFO:teuthology.orchestra.run.smithi100.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-10T21:03:28.467 INFO:teuthology.orchestra.run.smithi130.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.5 MB/s | 225 kB 00:00 2024-09-10T21:03:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 586 kB/s | 34 kB 00:00 2024-09-10T21:03:28.547 INFO:teuthology.orchestra.run.smithi100.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.3 MB/s | 154 kB 00:00 2024-09-10T21:03:28.668 INFO:teuthology.orchestra.run.smithi130.stdout:(12/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 17 MB 00:01 2024-09-10T21:03:28.680 INFO:teuthology.orchestra.run.smithi100.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 8.6 MB/s | 3.2 MB 00:00 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi130.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 110 kB/s | 27 kB 00:00 2024-09-10T21:03:28.760 INFO:teuthology.orchestra.run.smithi130.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 347 kB/s | 32 kB 00:00 2024-09-10T21:03:28.827 INFO:teuthology.orchestra.run.smithi130.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 6.6 MB/s | 755 kB 00:00 2024-09-10T21:03:28.852 INFO:teuthology.orchestra.run.smithi130.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.7 MB/s | 162 kB 00:00 2024-09-10T21:03:28.927 INFO:teuthology.orchestra.run.smithi130.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.2 MB/s | 127 kB 00:00 2024-09-10T21:03:29.028 INFO:teuthology.orchestra.run.smithi130.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 2.8 MB/s | 507 kB 00:00 2024-09-10T21:03:29.136 INFO:teuthology.orchestra.run.smithi130.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 417 kB/s | 45 kB 00:00 2024-09-10T21:03:29.237 INFO:teuthology.orchestra.run.smithi130.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.4 MB/s | 143 kB 00:00 2024-09-10T21:03:29.345 INFO:teuthology.orchestra.run.smithi130.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.5 MB/s | 161 kB 00:00 2024-09-10T21:03:29.578 INFO:teuthology.orchestra.run.smithi130.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 8.5 MB/s | 5.5 MB 00:00 2024-09-10T21:03:29.687 INFO:teuthology.orchestra.run.smithi130.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 2.8 MB/s | 306 kB 00:00 2024-09-10T21:03:29.771 INFO:teuthology.orchestra.run.smithi130.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.2 MB/s | 99 kB 00:00 2024-09-10T21:03:29.823 INFO:teuthology.orchestra.run.smithi100.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 6.5 MB/s | 7.4 MB 00:01 2024-09-10T21:03:29.829 INFO:teuthology.orchestra.run.smithi130.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-10T21:03:29.856 INFO:teuthology.orchestra.run.smithi130.stdout:(26/157): python3-rados-19.3.0-4854.g8f219c47.e 631 kB/s | 321 kB 00:00 2024-09-10T21:03:29.889 INFO:teuthology.orchestra.run.smithi100.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.3 MB/s | 291 kB 00:00 2024-09-10T21:03:29.955 INFO:teuthology.orchestra.run.smithi130.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.7 MB/s | 171 kB 00:00 2024-09-10T21:03:30.038 INFO:teuthology.orchestra.run.smithi130.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 412 kB/s | 34 kB 00:00 2024-09-10T21:03:30.056 INFO:teuthology.orchestra.run.smithi100.stdout:(33/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 9.4 MB/s | 14 MB 00:01 2024-09-10T21:03:30.081 INFO:teuthology.orchestra.run.smithi100.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 257 kB/s | 49 kB 00:00 2024-09-10T21:03:30.140 INFO:teuthology.orchestra.run.smithi100.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 197 kB/s | 16 kB 00:00 2024-09-10T21:03:30.147 INFO:teuthology.orchestra.run.smithi130.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 10 MB/s | 3.2 MB 00:00 2024-09-10T21:03:30.180 INFO:teuthology.orchestra.run.smithi130.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.1 MB/s | 154 kB 00:00 2024-09-10T21:03:30.190 INFO:teuthology.orchestra.run.smithi100.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 2.6 MB/s | 285 kB 00:00 2024-09-10T21:03:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 6.5 MB/s | 783 kB 00:00 2024-09-10T21:03:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 198 kB/s | 18 kB 00:00 2024-09-10T21:03:30.723 INFO:teuthology.orchestra.run.smithi130.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 18 MB/s | 50 MB 00:02 2024-09-10T21:03:30.773 INFO:teuthology.orchestra.run.smithi130.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 5.7 MB/s | 291 kB 00:00 2024-09-10T21:03:30.823 INFO:teuthology.orchestra.run.smithi130.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 1.0 MB/s | 49 kB 00:00 2024-09-10T21:03:30.833 INFO:teuthology.orchestra.run.smithi100.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 12 MB/s | 50 MB 00:04 2024-09-10T21:03:30.865 INFO:teuthology.orchestra.run.smithi130.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 397 kB/s | 16 kB 00:00 2024-09-10T21:03:30.915 INFO:teuthology.orchestra.run.smithi130.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 5.6 MB/s | 285 kB 00:00 2024-09-10T21:03:31.032 INFO:teuthology.orchestra.run.smithi130.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 8.7 MB/s | 7.4 MB 00:00 2024-09-10T21:03:31.066 INFO:teuthology.orchestra.run.smithi130.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 5.1 MB/s | 783 kB 00:00 2024-09-10T21:03:31.100 INFO:teuthology.orchestra.run.smithi130.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 274 kB/s | 18 kB 00:00 2024-09-10T21:03:31.258 INFO:teuthology.orchestra.run.smithi130.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 13 MB/s | 14 MB 00:01 2024-09-10T21:03:31.344 INFO:teuthology.orchestra.run.smithi100.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 73 kB/s | 80 kB 00:01 2024-09-10T21:03:31.426 INFO:teuthology.orchestra.run.smithi130.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 222 kB/s | 80 kB 00:00 2024-09-10T21:03:31.509 INFO:teuthology.orchestra.run.smithi130.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 764 kB/s | 191 kB 00:00 2024-09-10T21:03:31.534 INFO:teuthology.orchestra.run.smithi130.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-10T21:03:31.576 INFO:teuthology.orchestra.run.smithi130.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-10T21:03:31.600 INFO:teuthology.orchestra.run.smithi100.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 249 kB/s | 191 kB 00:00 2024-09-10T21:03:31.601 INFO:teuthology.orchestra.run.smithi130.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-10T21:03:31.634 INFO:teuthology.orchestra.run.smithi100.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 593 kB/s | 801 kB 00:01 2024-09-10T21:03:31.635 INFO:teuthology.orchestra.run.smithi130.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T21:03:31.702 INFO:teuthology.orchestra.run.smithi130.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-10T21:03:31.727 INFO:teuthology.orchestra.run.smithi130.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-10T21:03:31.769 INFO:teuthology.orchestra.run.smithi130.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-09-10T21:03:31.904 INFO:teuthology.orchestra.run.smithi130.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-09-10T21:03:31.970 INFO:teuthology.orchestra.run.smithi130.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-10T21:03:32.012 INFO:teuthology.orchestra.run.smithi130.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-10T21:03:32.062 INFO:teuthology.orchestra.run.smithi130.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 136 kB/s | 22 kB 00:00 2024-09-10T21:03:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-10T21:03:32.092 INFO:teuthology.orchestra.run.smithi100.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 339 kB/s | 253 kB 00:00 2024-09-10T21:03:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-09-10T21:03:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 160 kB/s | 18 kB 00:00 2024-09-10T21:03:32.246 INFO:teuthology.orchestra.run.smithi130.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-10T21:03:32.271 INFO:teuthology.orchestra.run.smithi130.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.4 MB/s | 171 kB 00:00 2024-09-10T21:03:32.372 INFO:teuthology.orchestra.run.smithi130.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-10T21:03:32.389 INFO:teuthology.orchestra.run.smithi100.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 141 kB/s | 106 kB 00:00 2024-09-10T21:03:32.455 INFO:teuthology.orchestra.run.smithi130.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 246 kB/s | 45 kB 00:00 2024-09-10T21:03:32.568 INFO:teuthology.orchestra.run.smithi100.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-10T21:03:32.639 INFO:teuthology.orchestra.run.smithi130.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-10T21:03:32.672 INFO:teuthology.orchestra.run.smithi130.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-10T21:03:32.714 INFO:teuthology.orchestra.run.smithi130.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-10T21:03:32.757 INFO:teuthology.orchestra.run.smithi130.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 569 kB/s | 47 kB 00:00 2024-09-10T21:03:32.802 INFO:teuthology.orchestra.run.smithi100.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 191 kB/s | 135 kB 00:00 2024-09-10T21:03:32.815 INFO:teuthology.orchestra.run.smithi130.stdout:(64/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-10T21:03:32.840 INFO:teuthology.orchestra.run.smithi130.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-10T21:03:32.882 INFO:teuthology.orchestra.run.smithi130.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 578 kB/s | 38 kB 00:00 2024-09-10T21:03:32.907 INFO:teuthology.orchestra.run.smithi130.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-10T21:03:33.127 INFO:teuthology.orchestra.run.smithi100.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 170 kB/s | 125 kB 00:00 2024-09-10T21:03:33.425 INFO:teuthology.orchestra.run.smithi130.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-09-10T21:03:33.435 INFO:teuthology.orchestra.run.smithi100.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 248 kB/s | 215 kB 00:00 2024-09-10T21:03:33.461 INFO:teuthology.orchestra.run.smithi100.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-09-10T21:03:33.536 INFO:teuthology.orchestra.run.smithi100.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 290 kB/s | 22 kB 00:00 2024-09-10T21:03:33.600 INFO:teuthology.orchestra.run.smithi130.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-09-10T21:03:33.658 INFO:teuthology.orchestra.run.smithi130.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T21:03:33.703 INFO:teuthology.orchestra.run.smithi100.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-10T21:03:33.728 INFO:teuthology.orchestra.run.smithi100.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 366 kB/s | 107 kB 00:00 2024-09-10T21:03:33.767 INFO:teuthology.orchestra.run.smithi130.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 2.6 MB/s | 910 kB 00:00 2024-09-10T21:03:33.778 INFO:teuthology.orchestra.run.smithi100.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-10T21:03:33.829 INFO:teuthology.orchestra.run.smithi100.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-10T21:03:33.947 INFO:teuthology.orchestra.run.smithi100.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 108 kB/s | 18 kB 00:00 2024-09-10T21:03:33.980 INFO:teuthology.orchestra.run.smithi100.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 74 kB/s | 11 kB 00:00 2024-09-10T21:03:34.059 INFO:teuthology.orchestra.run.smithi130.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.1 MB/s | 4.9 MB 00:01 2024-09-10T21:03:34.071 INFO:teuthology.orchestra.run.smithi100.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-10T21:03:34.105 INFO:teuthology.orchestra.run.smithi100.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-10T21:03:34.126 INFO:teuthology.orchestra.run.smithi130.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-10T21:03:34.139 INFO:teuthology.orchestra.run.smithi100.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 675 kB/s | 45 kB 00:00 2024-09-10T21:03:34.151 INFO:teuthology.orchestra.run.smithi130.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 955 kB/s | 87 kB 00:00 2024-09-10T21:03:34.218 INFO:teuthology.orchestra.run.smithi130.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 920 kB/s | 61 kB 00:00 2024-09-10T21:03:34.310 INFO:teuthology.orchestra.run.smithi130.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-10T21:03:34.402 INFO:teuthology.orchestra.run.smithi130.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-10T21:03:34.405 INFO:teuthology.orchestra.run.smithi100.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 2.1 MB/s | 581 kB 00:00 2024-09-10T21:03:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-09-10T21:03:34.472 INFO:teuthology.orchestra.run.smithi100.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-10T21:03:34.489 INFO:teuthology.orchestra.run.smithi130.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 295 kB/s | 26 kB 00:00 2024-09-10T21:03:34.523 INFO:teuthology.orchestra.run.smithi100.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-10T21:03:34.561 INFO:teuthology.orchestra.run.smithi130.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 270 kB/s | 19 kB 00:00 2024-09-10T21:03:34.640 INFO:teuthology.orchestra.run.smithi100.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-10T21:03:34.644 INFO:teuthology.orchestra.run.smithi130.stdout:(80/157): postgresql-server-13.16-1.el9.x86_64. 5.9 MB/s | 5.8 MB 00:00 2024-09-10T21:03:34.665 INFO:teuthology.orchestra.run.smithi100.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-10T21:03:34.669 INFO:teuthology.orchestra.run.smithi130.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-10T21:03:34.707 INFO:teuthology.orchestra.run.smithi100.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 576 kB/s | 38 kB 00:00 2024-09-10T21:03:34.720 INFO:teuthology.orchestra.run.smithi130.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-10T21:03:34.778 INFO:teuthology.orchestra.run.smithi130.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-10T21:03:34.837 INFO:teuthology.orchestra.run.smithi130.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T21:03:34.896 INFO:teuthology.orchestra.run.smithi130.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T21:03:34.963 INFO:teuthology.orchestra.run.smithi130.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 636 kB/s | 42 kB 00:00 2024-09-10T21:03:35.021 INFO:teuthology.orchestra.run.smithi130.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-10T21:03:35.074 INFO:teuthology.orchestra.run.smithi100.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-09-10T21:03:35.080 INFO:teuthology.orchestra.run.smithi130.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T21:03:35.139 INFO:teuthology.orchestra.run.smithi130.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-10T21:03:35.222 INFO:teuthology.orchestra.run.smithi130.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 614 kB/s | 51 kB 00:00 2024-09-10T21:03:35.306 INFO:teuthology.orchestra.run.smithi130.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 646 kB/s | 54 kB 00:00 2024-09-10T21:03:35.414 INFO:teuthology.orchestra.run.smithi130.stdout:(92/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-09-10T21:03:35.498 INFO:teuthology.orchestra.run.smithi130.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 501 kB/s | 42 kB 00:00 2024-09-10T21:03:35.581 INFO:teuthology.orchestra.run.smithi130.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 531 kB/s | 44 kB 00:00 2024-09-10T21:03:35.640 INFO:teuthology.orchestra.run.smithi130.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T21:03:35.641 INFO:teuthology.orchestra.run.smithi100.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 2.8 MB/s | 1.6 MB 00:00 2024-09-10T21:03:35.724 INFO:teuthology.orchestra.run.smithi130.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 432 kB/s | 36 kB 00:00 2024-09-10T21:03:35.824 INFO:teuthology.orchestra.run.smithi130.stdout:(97/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-10T21:03:35.883 INFO:teuthology.orchestra.run.smithi130.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 298 kB/s | 47 kB 00:00 2024-09-10T21:03:35.941 INFO:teuthology.orchestra.run.smithi100.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.0 MB/s | 910 kB 00:00 2024-09-10T21:03:35.941 INFO:teuthology.orchestra.run.smithi130.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-10T21:03:35.992 INFO:teuthology.orchestra.run.smithi130.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-10T21:03:36.016 INFO:teuthology.orchestra.run.smithi100.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-10T21:03:36.034 INFO:teuthology.orchestra.run.smithi130.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-10T21:03:36.084 INFO:teuthology.orchestra.run.smithi130.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 694 kB/s | 64 kB 00:00 2024-09-10T21:03:36.167 INFO:teuthology.orchestra.run.smithi130.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 336 kB/s | 45 kB 00:00 2024-09-10T21:03:36.217 INFO:teuthology.orchestra.run.smithi100.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-09-10T21:03:36.218 INFO:teuthology.orchestra.run.smithi130.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-10T21:03:36.293 INFO:teuthology.orchestra.run.smithi130.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-10T21:03:36.327 INFO:teuthology.orchestra.run.smithi130.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.3 MB/s | 863 kB 00:00 2024-09-10T21:03:36.358 INFO:teuthology.orchestra.run.smithi100.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.9 MB/s | 4.9 MB 00:01 2024-09-10T21:03:36.368 INFO:teuthology.orchestra.run.smithi130.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-09-10T21:03:36.419 INFO:teuthology.orchestra.run.smithi130.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 212 kB/s | 19 kB 00:00 2024-09-10T21:03:36.428 INFO:teuthology.orchestra.run.smithi100.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T21:03:36.469 INFO:teuthology.orchestra.run.smithi130.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-10T21:03:36.519 INFO:teuthology.orchestra.run.smithi130.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 976 kB/s | 49 kB 00:00 2024-09-10T21:03:36.545 INFO:teuthology.orchestra.run.smithi130.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T21:03:36.578 INFO:teuthology.orchestra.run.smithi130.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T21:03:36.592 INFO:teuthology.orchestra.run.smithi100.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-09-10T21:03:36.654 INFO:teuthology.orchestra.run.smithi130.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-10T21:03:36.695 INFO:teuthology.orchestra.run.smithi130.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-10T21:03:36.718 INFO:teuthology.orchestra.run.smithi100.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 490 kB/s | 61 kB 00:00 2024-09-10T21:03:36.737 INFO:teuthology.orchestra.run.smithi130.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-10T21:03:36.804 INFO:teuthology.orchestra.run.smithi130.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 483 kB/s | 32 kB 00:00 2024-09-10T21:03:36.835 INFO:teuthology.orchestra.run.smithi100.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-10T21:03:36.846 INFO:teuthology.orchestra.run.smithi130.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 341 kB/s | 14 kB 00:00 2024-09-10T21:03:36.880 INFO:teuthology.orchestra.run.smithi130.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-10T21:03:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-10T21:03:36.952 INFO:teuthology.orchestra.run.smithi100.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-10T21:03:36.962 INFO:teuthology.orchestra.run.smithi130.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.2 MB/s | 303 kB 00:00 2024-09-10T21:03:36.996 INFO:teuthology.orchestra.run.smithi130.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-10T21:03:37.035 INFO:teuthology.orchestra.run.smithi100.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 309 kB/s | 26 kB 00:00 2024-09-10T21:03:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:(122/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-10T21:03:37.096 INFO:teuthology.orchestra.run.smithi130.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T21:03:37.102 INFO:teuthology.orchestra.run.smithi100.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 288 kB/s | 19 kB 00:00 2024-09-10T21:03:37.177 INFO:teuthology.orchestra.run.smithi100.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-10T21:03:37.244 INFO:teuthology.orchestra.run.smithi100.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 522 kB/s | 35 kB 00:00 2024-09-10T21:03:37.263 INFO:teuthology.orchestra.run.smithi130.stdout:(124/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.3 MB/s | 16 MB 00:01 2024-09-10T21:03:37.313 INFO:teuthology.orchestra.run.smithi130.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 49 kB/s | 11 kB 00:00 2024-09-10T21:03:37.355 INFO:teuthology.orchestra.run.smithi130.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 583 kB/s | 23 kB 00:00 2024-09-10T21:03:37.397 INFO:teuthology.orchestra.run.smithi130.stdout:(127/157): python3-jaraco-classes-3.2.1-5.el9.n 133 kB/s | 18 kB 00:00 2024-09-10T21:03:37.439 INFO:teuthology.orchestra.run.smithi130.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-09-10T21:03:37.481 INFO:teuthology.orchestra.run.smithi130.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-09-10T21:03:37.515 INFO:teuthology.orchestra.run.smithi130.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-10T21:03:37.557 INFO:teuthology.orchestra.run.smithi130.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-09-10T21:03:37.561 INFO:teuthology.orchestra.run.smithi100.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 3.7 MB/s | 5.8 MB 00:01 2024-09-10T21:03:37.582 INFO:teuthology.orchestra.run.smithi130.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T21:03:37.624 INFO:teuthology.orchestra.run.smithi130.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-10T21:03:37.649 INFO:teuthology.orchestra.run.smithi130.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 665 kB/s | 16 kB 00:00 2024-09-10T21:03:37.675 INFO:teuthology.orchestra.run.smithi130.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T21:03:37.678 INFO:teuthology.orchestra.run.smithi100.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-10T21:03:37.708 INFO:teuthology.orchestra.run.smithi130.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-10T21:03:37.725 INFO:teuthology.orchestra.run.smithi130.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-10T21:03:37.742 INFO:teuthology.orchestra.run.smithi130.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 919 kB/s | 31 kB 00:00 2024-09-10T21:03:37.767 INFO:teuthology.orchestra.run.smithi130.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T21:03:37.784 INFO:teuthology.orchestra.run.smithi130.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-10T21:03:37.787 INFO:teuthology.orchestra.run.smithi100.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-10T21:03:37.809 INFO:teuthology.orchestra.run.smithi130.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-10T21:03:37.860 INFO:teuthology.orchestra.run.smithi130.stdout:(142/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.4 MB/s | 2.0 MB 00:00 2024-09-10T21:03:37.862 INFO:teuthology.orchestra.run.smithi100.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-10T21:03:37.885 INFO:teuthology.orchestra.run.smithi130.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 741 kB/s | 74 kB 00:00 2024-09-10T21:03:37.910 INFO:teuthology.orchestra.run.smithi130.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T21:03:37.929 INFO:teuthology.orchestra.run.smithi100.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 634 kB/s | 42 kB 00:00 2024-09-10T21:03:37.936 INFO:teuthology.orchestra.run.smithi130.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-09-10T21:03:37.961 INFO:teuthology.orchestra.run.smithi130.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-09-10T21:03:37.995 INFO:teuthology.orchestra.run.smithi130.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T21:03:38.020 INFO:teuthology.orchestra.run.smithi130.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T21:03:38.087 INFO:teuthology.orchestra.run.smithi130.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-10T21:03:38.105 INFO:teuthology.orchestra.run.smithi100.stdout:(87/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.6 MB/s | 6.0 MB 00:01 2024-09-10T21:03:38.130 INFO:teuthology.orchestra.run.smithi100.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 1.3 MB/s | 269 kB 00:00 2024-09-10T21:03:38.213 INFO:teuthology.orchestra.run.smithi100.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-10T21:03:38.239 INFO:teuthology.orchestra.run.smithi100.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-10T21:03:38.270 INFO:teuthology.orchestra.run.smithi130.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-10T21:03:38.322 INFO:teuthology.orchestra.run.smithi100.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-10T21:03:38.354 INFO:teuthology.orchestra.run.smithi130.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 9.7 MB/s | 3.5 MB 00:00 2024-09-10T21:03:38.356 INFO:teuthology.orchestra.run.smithi100.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 460 kB/s | 54 kB 00:00 2024-09-10T21:03:38.423 INFO:teuthology.orchestra.run.smithi100.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-09-10T21:03:38.471 INFO:teuthology.orchestra.run.smithi130.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 349 kB/s | 41 kB 00:00 2024-09-10T21:03:38.498 INFO:teuthology.orchestra.run.smithi100.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 590 kB/s | 44 kB 00:00 2024-09-10T21:03:38.521 INFO:teuthology.orchestra.run.smithi130.stdout:(153/157): NetworkManager-1.49.90-1.el9.x86_64. 5.3 MB/s | 2.3 MB 00:00 2024-09-10T21:03:38.580 INFO:teuthology.orchestra.run.smithi130.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 5.8 MB/s | 1.8 MB 00:00 2024-09-10T21:03:38.605 INFO:teuthology.orchestra.run.smithi130.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-10T21:03:38.631 INFO:teuthology.orchestra.run.smithi100.stdout:(95/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.7 MB/s | 5.1 MB 00:01 2024-09-10T21:03:38.657 INFO:teuthology.orchestra.run.smithi100.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-10T21:03:38.680 INFO:teuthology.orchestra.run.smithi130.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-10T21:03:38.699 INFO:teuthology.orchestra.run.smithi100.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-09-10T21:03:38.724 INFO:teuthology.orchestra.run.smithi100.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-10T21:03:38.780 INFO:teuthology.orchestra.run.smithi130.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-10T21:03:38.786 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:03:38.787 INFO:teuthology.orchestra.run.smithi130.stdout:Total 18 MB/s | 240 MB 00:13 2024-09-10T21:03:38.816 INFO:teuthology.orchestra.run.smithi100.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-10T21:03:38.841 INFO:teuthology.orchestra.run.smithi100.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-09-10T21:03:38.875 INFO:teuthology.orchestra.run.smithi100.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T21:03:38.934 INFO:teuthology.orchestra.run.smithi100.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-10T21:03:38.967 INFO:teuthology.orchestra.run.smithi100.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 508 kB/s | 64 kB 00:00 2024-09-10T21:03:39.068 INFO:teuthology.orchestra.run.smithi100.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-10T21:03:39.143 INFO:teuthology.orchestra.run.smithi100.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-10T21:03:39.177 INFO:teuthology.orchestra.run.smithi100.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T21:03:39.202 INFO:teuthology.orchestra.run.smithi100.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 790 kB/s | 19 kB 00:00 2024-09-10T21:03:39.269 INFO:teuthology.orchestra.run.smithi100.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-09-10T21:03:39.319 INFO:teuthology.orchestra.run.smithi100.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-10T21:03:39.353 INFO:teuthology.orchestra.run.smithi100.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T21:03:39.386 INFO:teuthology.orchestra.run.smithi100.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T21:03:39.420 INFO:teuthology.orchestra.run.smithi100.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T21:03:39.487 INFO:teuthology.orchestra.run.smithi100.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-10T21:03:39.537 INFO:teuthology.orchestra.run.smithi100.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-10T21:03:39.587 INFO:teuthology.orchestra.run.smithi100.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 872 kB/s | 43 kB 00:00 2024-09-10T21:03:39.613 INFO:teuthology.orchestra.run.smithi100.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T21:03:39.638 INFO:teuthology.orchestra.run.smithi100.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-10T21:03:39.663 INFO:teuthology.orchestra.run.smithi100.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.0 MB/s | 548 kB 00:00 2024-09-10T21:03:39.688 INFO:teuthology.orchestra.run.smithi100.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T21:03:39.722 INFO:teuthology.orchestra.run.smithi100.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T21:03:39.747 INFO:teuthology.orchestra.run.smithi100.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-10T21:03:39.773 INFO:teuthology.orchestra.run.smithi100.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T21:03:39.807 INFO:teuthology.orchestra.run.smithi100.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T21:03:39.832 INFO:teuthology.orchestra.run.smithi100.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-10T21:03:39.857 INFO:teuthology.orchestra.run.smithi100.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 718 kB/s | 18 kB 00:00 2024-09-10T21:03:39.882 INFO:teuthology.orchestra.run.smithi100.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-10T21:03:39.908 INFO:teuthology.orchestra.run.smithi100.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 790 kB/s | 19 kB 00:00 2024-09-10T21:03:39.933 INFO:teuthology.orchestra.run.smithi100.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-09-10T21:03:39.983 INFO:teuthology.orchestra.run.smithi100.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-10T21:03:40.009 INFO:teuthology.orchestra.run.smithi100.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T21:03:40.034 INFO:teuthology.orchestra.run.smithi100.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T21:03:40.059 INFO:teuthology.orchestra.run.smithi100.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T21:03:40.126 INFO:teuthology.orchestra.run.smithi100.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-10T21:03:40.152 INFO:teuthology.orchestra.run.smithi100.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-10T21:03:40.177 INFO:teuthology.orchestra.run.smithi100.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-10T21:03:40.202 INFO:teuthology.orchestra.run.smithi100.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-10T21:03:40.227 INFO:teuthology.orchestra.run.smithi100.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 566 kB/s | 28 kB 00:00 2024-09-10T21:03:40.252 INFO:teuthology.orchestra.run.smithi100.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-10T21:03:40.278 INFO:teuthology.orchestra.run.smithi100.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T21:03:40.303 INFO:teuthology.orchestra.run.smithi100.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T21:03:40.329 INFO:teuthology.orchestra.run.smithi100.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T21:03:40.345 INFO:teuthology.orchestra.run.smithi100.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-10T21:03:40.379 INFO:teuthology.orchestra.run.smithi100.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-10T21:03:40.404 INFO:teuthology.orchestra.run.smithi100.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T21:03:40.421 INFO:teuthology.orchestra.run.smithi100.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-10T21:03:40.463 INFO:teuthology.orchestra.run.smithi100.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-10T21:03:40.497 INFO:teuthology.orchestra.run.smithi100.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-10T21:03:40.564 INFO:teuthology.orchestra.run.smithi100.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T21:03:40.831 INFO:teuthology.orchestra.run.smithi100.stdout:(149/157): librados2-19.3.0-4854.g8f219c47.el9. 10 MB/s | 3.5 MB 00:00 2024-09-10T21:03:40.863 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-09-10T21:03:40.889 INFO:teuthology.orchestra.run.smithi100.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-10T21:03:41.048 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-09-10T21:03:41.048 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-09-10T21:03:41.975 INFO:teuthology.orchestra.run.smithi100.stdout:(151/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.4 MB/s | 16 MB 00:03 2024-09-10T21:03:42.550 INFO:teuthology.orchestra.run.smithi100.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 71 kB/s | 41 kB 00:00 2024-09-10T21:03:43.400 INFO:teuthology.orchestra.run.smithi100.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 293 kB/s | 249 kB 00:00 2024-09-10T21:03:43.484 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-09-10T21:03:43.485 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-09-10T21:03:43.626 INFO:teuthology.orchestra.run.smithi100.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 675 kB/s | 1.8 MB 00:02 2024-09-10T21:03:44.318 INFO:teuthology.orchestra.run.smithi100.stdout:(155/157): NetworkManager-1.49.90-1.el9.x86_64. 681 kB/s | 2.3 MB 00:03 2024-09-10T21:03:45.593 INFO:teuthology.orchestra.run.smithi100.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 632 kB/s | 1.4 MB 00:02 2024-09-10T21:03:46.801 INFO:teuthology.orchestra.run.smithi100.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 772 kB/s | 2.4 MB 00:03 2024-09-10T21:03:46.808 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:03:46.808 INFO:teuthology.orchestra.run.smithi100.stdout:Total 11 MB/s | 240 MB 00:22 2024-09-10T21:03:48.871 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-10T21:03:49.052 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-10T21:03:49.052 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-10T21:03:50.491 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-09-10T21:03:50.635 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T21:03:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T21:03:50.768 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T21:03:50.812 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T21:03:50.844 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T21:03:50.909 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T21:03:51.277 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T21:03:51.386 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:51.497 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-10T21:03:51.497 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-10T21:03:51.547 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:51.579 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:51.684 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:51.720 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:03:51.758 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T21:03:51.971 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T21:03:52.032 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T21:03:52.059 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:03:52.185 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:03:52.226 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:03:52.300 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:03:52.327 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:03:52.366 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:03:52.603 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:03:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:03:53.026 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T21:03:53.144 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:53.285 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:53.558 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:53.690 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T21:03:53.723 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T21:03:53.768 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T21:03:53.883 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T21:03:53.937 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T21:03:53.984 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T21:03:54.038 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T21:03:54.077 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T21:03:54.111 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T21:03:54.198 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T21:03:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T21:03:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T21:03:54.344 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T21:03:54.426 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T21:03:54.460 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T21:03:54.504 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T21:03:54.532 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T21:03:54.638 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T21:03:54.692 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T21:03:54.782 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T21:03:54.944 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T21:03:55.004 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T21:03:55.640 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T21:03:55.745 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T21:03:55.790 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T21:03:55.835 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T21:03:55.872 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T21:03:55.925 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T21:03:56.107 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T21:03:56.208 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T21:03:56.315 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T21:03:56.532 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T21:03:56.705 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T21:03:56.755 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T21:03:56.791 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T21:03:56.850 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T21:03:56.908 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T21:03:56.952 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T21:03:57.002 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T21:03:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T21:03:57.227 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T21:03:57.270 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T21:03:57.387 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T21:03:57.427 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T21:03:57.469 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T21:03:57.499 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T21:03:57.524 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T21:03:57.660 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T21:03:57.825 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T21:03:57.865 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T21:03:57.936 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T21:03:57.986 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T21:03:58.026 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T21:03:58.065 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T21:03:58.103 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T21:03:58.136 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T21:03:58.168 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T21:03:58.212 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T21:03:58.245 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T21:03:58.352 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T21:03:58.434 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T21:03:58.457 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-10T21:03:58.473 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T21:03:58.594 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T21:03:58.606 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T21:03:58.651 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T21:03:58.656 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T21:03:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T21:03:58.766 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T21:03:58.798 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T21:03:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T21:03:59.243 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T21:03:59.349 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:59.526 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:59.540 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T21:03:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:59.596 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T21:03:59.629 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T21:03:59.687 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:59.729 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:03:59.745 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T21:03:59.771 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T21:03:59.812 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T21:03:59.866 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T21:03:59.963 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T21:03:59.982 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T21:04:00.014 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T21:04:00.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T21:04:00.080 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:04:00.249 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T21:04:00.273 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:04:00.278 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T21:04:00.298 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:04:00.371 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T21:04:00.405 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:04:00.432 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:04:00.478 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:04:00.843 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:04:01.037 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:04:01.177 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T21:04:01.225 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T21:04:01.324 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T21:04:01.356 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:04:01.449 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:04:01.726 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T21:04:01.905 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T21:04:01.948 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T21:04:02.031 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T21:04:02.093 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T21:04:02.132 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T21:04:02.185 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T21:04:02.226 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T21:04:02.275 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T21:04:02.362 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T21:04:02.435 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T21:04:02.471 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T21:04:02.517 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T21:04:02.598 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T21:04:02.633 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T21:04:02.676 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T21:04:02.705 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T21:04:02.785 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T21:04:02.840 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T21:04:02.878 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T21:04:02.931 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T21:04:02.982 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T21:04:03.051 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T21:04:03.089 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T21:04:03.101 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T21:04:03.152 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T21:04:03.445 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T21:04:03.495 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:04:03.607 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:04:03.643 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T21:04:03.691 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T21:04:03.786 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T21:04:03.885 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T21:04:03.930 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T21:04:03.975 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T21:04:04.012 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T21:04:04.086 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T21:04:04.220 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T21:04:04.248 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:04:04.273 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T21:04:04.330 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:04:04.358 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T21:04:04.407 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T21:04:04.521 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T21:04:04.593 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T21:04:04.677 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T21:04:04.717 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T21:04:04.762 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T21:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T21:04:04.886 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T21:04:04.931 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T21:04:04.981 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T21:04:05.154 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T21:04:05.198 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T21:04:05.241 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T21:04:05.360 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T21:04:05.407 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T21:04:05.449 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T21:04:05.479 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T21:04:05.503 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T21:04:05.622 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T21:04:05.774 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T21:04:05.823 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T21:04:05.855 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T21:04:05.904 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T21:04:05.952 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T21:04:05.991 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T21:04:06.028 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T21:04:06.063 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T21:04:06.096 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T21:04:06.139 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T21:04:06.172 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T21:04:06.270 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T21:04:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T21:04:06.359 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T21:04:06.504 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T21:04:06.563 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T21:04:06.854 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:04:06.897 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:04:07.441 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T21:04:07.499 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T21:04:07.532 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T21:04:07.554 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:04:07.601 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:04:07.646 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T21:04:07.717 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T21:04:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:04:07.753 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T21:04:07.753 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T21:04:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:07.770 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T21:04:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:04:07.865 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T21:04:07.929 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T21:04:08.169 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T21:04:08.200 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T21:04:08.293 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T21:04:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T21:04:09.254 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T21:04:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T21:04:10.914 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T21:04:10.949 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T21:04:11.014 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T21:04:11.368 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T21:04:11.411 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:04:11.522 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:04:11.558 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T21:04:11.607 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T21:04:12.139 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T21:04:12.172 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:04:12.296 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:04:12.324 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T21:04:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:04:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:04:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:04:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:04:15.996 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:04:15.996 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T21:04:15.996 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T21:04:15.996 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:04:20.240 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:04:20.240 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2024-09-10T21:04:20.241 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2024-09-10T21:04:20.241 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2024-09-10T21:04:20.241 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2024-09-10T21:04:20.241 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2024-09-10T21:04:20.241 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2024-09-10T21:04:20.241 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2024-09-10T21:04:20.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:20.453 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:04:20.489 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:04:20.489 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:20.489 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T21:04:20.489 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:22.122 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:04:22.179 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:04:22.179 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:22.179 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T21:04:22.179 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:04:22.179 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:04:22.180 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:22.430 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:04:22.481 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:04:22.482 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:22.482 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T21:04:22.482 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:04:22.482 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:04:22.482 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:22.981 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:04:23.032 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:04:23.032 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:23.032 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T21:04:23.032 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:04:23.032 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:04:23.032 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:23.164 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T21:04:23.225 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T21:04:23.289 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T21:04:23.517 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T21:04:23.577 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T21:04:23.663 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T21:04:23.781 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T21:04:23.946 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T21:04:23.993 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T21:04:24.041 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T21:04:24.066 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T21:04:24.641 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:04:24.682 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:04:24.716 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T21:04:24.798 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T21:04:24.838 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:04:28.491 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:04:28.561 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:04:29.021 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:04:29.021 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-10T21:04:29.021 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-10T21:04:29.022 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-10T21:04:29.022 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-10T21:04:29.022 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-10T21:04:29.022 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-10T21:04:29.022 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-10T21:04:29.022 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:29.240 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:04:29.276 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:04:29.276 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:29.276 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T21:04:29.276 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:29.648 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:04:29.677 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:04:29.830 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:04:30.001 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T21:04:30.029 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:04:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:04:30.080 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:30.080 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T21:04:30.080 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:04:30.080 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:04:30.080 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:30.138 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:04:30.164 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:04:30.272 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T21:04:30.353 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T21:04:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:04:30.943 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:04:30.943 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:30.943 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T21:04:30.943 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:04:30.943 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:04:30.943 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:31.209 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:04:31.260 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:04:31.260 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:31.260 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T21:04:31.260 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:04:31.260 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:04:31.260 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:31.402 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T21:04:31.440 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:04:31.491 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:04:31.491 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:31.491 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T21:04:31.491 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:04:31.491 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:04:31.492 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:31.557 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:04:31.607 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:04:31.607 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:31.607 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T21:04:31.608 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:31.658 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:04:31.709 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:04:31.709 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:31.709 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T21:04:31.709 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:04:31.709 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:04:31.710 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:04:31.845 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:04:31.845 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:31.845 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T21:04:31.845 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:04:31.845 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:04:31.845 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:31.969 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T21:04:32.029 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T21:04:32.050 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:04:32.093 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T21:04:32.102 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:04:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T21:04:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:04:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:04:32.102 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:32.318 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T21:04:32.381 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T21:04:32.466 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T21:04:32.575 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T21:04:32.731 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T21:04:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T21:04:32.838 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T21:04:32.863 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T21:04:33.386 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:04:33.421 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:04:33.455 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T21:04:33.535 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T21:04:33.576 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:04:37.171 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:04:37.206 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T21:04:37.233 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:04:37.264 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T21:04:37.308 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T21:04:37.337 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T21:04:37.372 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T21:04:37.610 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T21:04:37.652 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T21:04:37.682 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T21:04:37.730 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T21:04:37.782 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T21:04:38.314 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:04:38.375 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:04:38.527 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:04:38.552 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:38.604 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:38.646 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T21:04:38.735 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:04:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:04:38.787 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:38.787 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T21:04:38.787 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:04:38.787 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:04:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:38.853 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:04:38.879 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:04:39.019 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T21:04:39.096 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T21:04:39.906 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T21:04:40.009 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T21:04:40.064 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T21:04:40.145 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T21:04:40.180 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T21:04:40.181 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:04:40.228 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T21:04:40.231 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:04:40.231 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:40.232 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T21:04:40.232 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:04:40.232 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:04:40.232 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:40.275 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T21:04:40.290 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:04:40.315 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T21:04:40.315 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:04:40.339 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:04:40.339 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:40.339 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T21:04:40.339 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:04:40.414 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:04:40.414 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:04:40.450 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:04:40.450 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:40.450 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T21:04:40.450 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:04:40.451 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:04:40.451 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:40.515 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:04:40.539 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T21:04:40.554 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:40.555 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:40.799 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:04:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:40.800 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:04:40.850 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:04:40.850 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:04:40.851 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T21:04:40.851 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:04:40.851 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:04:40.851 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:40.909 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:04:40.983 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:41.203 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:41.203 INFO:teuthology.orchestra.run.smithi130.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T21:04:41.203 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:45.938 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T21:04:45.979 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T21:04:46.023 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T21:04:46.052 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T21:04:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T21:04:46.353 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T21:04:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T21:04:46.440 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T21:04:46.471 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T21:04:46.532 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T21:04:47.350 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T21:04:47.350 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T21:04:47.350 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T21:04:47.350 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T21:04:47.350 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T21:04:47.350 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T21:04:47.350 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T21:04:47.351 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T21:04:47.352 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T21:04:47.353 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T21:04:47.354 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T21:04:47.355 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T21:04:47.356 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T21:04:47.357 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T21:04:47.358 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T21:04:47.359 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T21:04:47.360 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T21:04:47.361 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T21:04:47.362 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T21:04:47.363 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T21:04:47.363 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T21:04:47.363 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T21:04:47.363 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T21:04:47.363 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T21:04:47.363 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T21:04:47.470 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:47.522 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:47.564 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:48.825 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T21:04:48.936 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T21:04:48.992 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T21:04:49.103 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T21:04:49.138 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T21:04:49.180 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T21:04:49.242 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T21:04:49.242 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:04:49.399 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:04:49.400 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:04:49.558 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.582 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.583 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.584 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T21:04:49.585 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.588 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T21:04:49.589 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T21:04:49.590 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T21:04:49.591 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T21:04:49.593 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.594 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.594 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:49.594 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T21:04:49.594 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T21:04:49.594 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T21:04:49.594 INFO:teuthology.orchestra.run.smithi130.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T21:04:49.594 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T21:04:49.594 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T21:04:49.595 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T21:04:49.595 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T21:04:49.595 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:04:49.595 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-09-10T21:04:49.598 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:49.598 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:49.844 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:49.844 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:04:49.961 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:04:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:50.224 DEBUG:teuthology.parallel:result is None 2024-09-10T21:04:50.246 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:50.263 INFO:teuthology.orchestra.run.smithi100.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T21:04:50.263 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T21:04:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T21:04:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T21:04:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T21:04:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T21:04:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T21:04:56.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T21:04:56.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T21:04:56.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T21:04:56.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T21:04:56.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T21:04:56.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T21:04:56.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T21:04:56.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T21:04:56.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T21:04:56.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T21:04:56.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T21:04:56.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T21:04:56.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T21:04:56.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T21:04:56.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T21:04:56.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T21:04:56.566 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T21:04:56.567 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T21:04:56.568 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T21:04:56.569 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T21:04:56.570 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T21:04:56.571 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T21:04:56.572 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T21:04:56.573 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T21:04:56.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T21:04:56.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T21:04:56.576 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T21:04:58.781 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:58.781 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:58.781 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-10T21:04:58.781 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:58.781 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:58.781 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.782 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.783 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T21:04:58.784 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T21:04:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T21:04:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T21:04:58.787 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T21:04:58.788 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T21:04:58.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T21:04:58.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T21:04:58.791 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T21:04:58.792 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T21:04:58.793 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T21:04:58.794 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:04:58.794 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-10T21:04:59.470 DEBUG:teuthology.parallel:result is None 2024-09-10T21:04:59.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:04:59.631 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T21:04:59.679 INFO:teuthology.orchestra.run.smithi100.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:59.680 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:59.680 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T21:04:59.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:04:59.843 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T21:04:59.894 INFO:teuthology.orchestra.run.smithi130.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:59.894 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:59.894 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T21:04:59.896 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T21:04:59.896 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:04:59.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T21:04:59.959 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:04:59.959 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T21:05:00.021 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T21:05:00.022 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:00.022 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T21:05:00.079 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T21:05:00.178 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:00.178 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T21:05:00.236 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T21:05:00.331 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T21:05:00.332 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:00.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T21:05:00.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T21:05:00.497 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:00.497 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T21:05:00.552 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T21:05:00.647 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T21:05:00.648 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:00.648 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T21:05:00.705 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T21:05:00.805 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:00.806 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T21:05:00.861 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T21:05:00.956 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T21:05:01.035 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T21:05:01.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-09-10T21:05:01.040 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2024-09-10T21:05:01.096 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T21:05:01.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T21:05:01.100 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T21:05:01.155 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T21:05:01.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T21:05:01.159 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T21:05:01.221 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T21:05:01.221 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T21:05:01.221 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T21:05:01.221 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:01.221 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T21:05:01.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T21:05:01.437 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T21:05:01.500 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:01.500 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T21:05:01.534 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T21:05:01.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T21:05:01.773 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T21:05:01.773 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T21:05:01.773 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-readahead}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899661', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDc2YUlaaXT5euBGb+RgWSc4I1m/j98gWo5Xy28nrEjPoNx++PI03o/E7xzytFPd4WcJY/rQ3Nh/GQWDpe4eZyw=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcpGzwuRGkw16a9KscmrsDchdfsOWjie2w2AK6R7ubp5OKpS5vxwTaHVCY88SXe0J10HmKWwWAXIskwQE7NrR8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_readahead']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T21:05:01.774 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T21:05:01.778 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T21:05:01.813 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T21:05:01.854 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T21:05:01.910 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:01.910 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T21:05:01.944 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T21:05:01.945 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-10T21:05:02.020 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T21:05:02.020 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:05:02.020 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-10T21:05:02.020 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:05:02.020 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:05:02.021 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 21:04:50.588378325 +0000 2024-09-10T21:05:02.021 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 21:02:30.782341429 +0000 2024-09-10T21:05:02.021 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 21:02:30.782341429 +0000 2024-09-10T21:05:02.021 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 21:02:30.782341429 +0000 2024-09-10T21:05:02.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T21:05:02.112 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T21:05:02.113 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T21:05:02.113 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00032616 s, 1.6 MB/s 2024-09-10T21:05:02.115 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T21:05:02.152 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-10T21:05:02.228 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T21:05:02.228 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:05:02.228 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-10T21:05:02.228 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:05:02.228 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:05:02.228 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 21:04:50.588378325 +0000 2024-09-10T21:05:02.228 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 21:02:31.235329752 +0000 2024-09-10T21:05:02.228 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 21:02:31.235329752 +0000 2024-09-10T21:05:02.229 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 21:02:31.235329752 +0000 2024-09-10T21:05:02.229 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T21:05:02.320 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T21:05:02.320 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T21:05:02.321 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000296226 s, 1.7 MB/s 2024-09-10T21:05:02.323 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T21:05:02.360 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-10T21:05:02.435 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T21:05:02.435 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:05:02.436 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-10T21:05:02.436 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:05:02.436 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:05:02.436 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 21:04:50.589378299 +0000 2024-09-10T21:05:02.436 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 21:02:31.754316375 +0000 2024-09-10T21:05:02.436 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 21:02:31.754316375 +0000 2024-09-10T21:05:02.436 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 21:02:31.754316375 +0000 2024-09-10T21:05:02.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T21:05:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T21:05:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T21:05:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000268032 s, 1.9 MB/s 2024-09-10T21:05:02.531 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T21:05:02.567 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-10T21:05:02.642 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T21:05:02.642 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:05:02.642 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-10T21:05:02.642 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:05:02.643 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:05:02.643 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 21:04:50.590378273 +0000 2024-09-10T21:05:02.643 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 21:02:32.240303848 +0000 2024-09-10T21:05:02.643 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 21:02:32.240303848 +0000 2024-09-10T21:05:02.643 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 21:02:32.240303848 +0000 2024-09-10T21:05:02.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T21:05:02.749 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T21:05:02.749 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T21:05:02.749 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000246338 s, 2.1 MB/s 2024-09-10T21:05:02.752 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T21:05:02.789 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:02.789 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:02.789 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T21:05:02.825 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T21:05:02.825 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-09-10T21:05:02.900 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T21:05:02.900 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:05:02.901 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-10T21:05:02.901 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:05:02.901 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:05:02.901 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-09-10 21:04:41.554093109 +0000 2024-09-10T21:05:02.901 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-09-10 21:02:32.383048637 +0000 2024-09-10T21:05:02.901 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-09-10 21:02:32.383048637 +0000 2024-09-10T21:05:02.901 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-09-10 21:02:32.383048637 +0000 2024-09-10T21:05:02.901 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T21:05:02.993 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-09-10T21:05:02.993 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-09-10T21:05:02.993 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000297423 s, 1.7 MB/s 2024-09-10T21:05:02.996 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T21:05:03.032 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-09-10T21:05:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T21:05:03.107 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:05:03.108 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-10T21:05:03.108 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:05:03.108 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:05:03.108 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-09-10 21:04:41.555093091 +0000 2024-09-10T21:05:03.108 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-09-10 21:02:32.836040654 +0000 2024-09-10T21:05:03.108 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-09-10 21:02:32.837040637 +0000 2024-09-10T21:05:03.108 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-09-10 21:02:32.836040654 +0000 2024-09-10T21:05:03.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T21:05:03.199 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-09-10T21:05:03.199 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-09-10T21:05:03.199 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000321861 s, 1.6 MB/s 2024-09-10T21:05:03.201 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T21:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-09-10 21:04:41.556093073 +0000 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-09-10 21:02:33.296032548 +0000 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-09-10 21:02:33.296032548 +0000 2024-09-10T21:05:03.313 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-09-10 21:02:33.296032548 +0000 2024-09-10T21:05:03.313 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T21:05:03.406 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-09-10T21:05:03.406 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-09-10T21:05:03.406 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000283424 s, 1.8 MB/s 2024-09-10T21:05:03.409 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T21:05:03.445 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-09-10T21:05:03.521 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T21:05:03.521 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:05:03.521 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-10T21:05:03.521 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:05:03.521 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:05:03.521 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-09-10 21:04:41.556093073 +0000 2024-09-10T21:05:03.521 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-09-10 21:02:33.774024126 +0000 2024-09-10T21:05:03.521 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-09-10 21:02:33.774024126 +0000 2024-09-10T21:05:03.522 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-09-10 21:02:33.774024126 +0000 2024-09-10T21:05:03.522 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T21:05:03.613 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-09-10T21:05:03.614 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-09-10T21:05:03.614 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.00027557 s, 1.9 MB/s 2024-09-10T21:05:03.616 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T21:05:03.652 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:03.652 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T21:05:03.653 INFO:tasks.ceph:Generating config... 2024-09-10T21:05:03.654 INFO:tasks.ceph:[client] pid file = 2024-09-10T21:05:03.654 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-10T21:05:03.654 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T21:05:03.654 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T21:05:03.654 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T21:05:03.654 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T21:05:03.654 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T21:05:03.654 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T21:05:03.654 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T21:05:03.654 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T21:05:03.654 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T21:05:03.654 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T21:05:03.655 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T21:05:03.655 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T21:05:03.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T21:05:03.753 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T21:05:03.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T21:05:03.844 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T21:05:03.899 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.b', '172.21.15.130'), ('mon.c', '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]')] 2024-09-10T21:05:03.900 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-10T21:05:03.901 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:03.901 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T21:05:03.935 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --add b 172.21.15.130 --addv c '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid 65dcb08a-1e46-42c5-ba37-fc802a6ee031 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = quincy 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 65dcb08a-1e46-42c5-ba37-fc802a6ee031 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2024-09-10T21:05:04.049191+0000 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-10T21:05:04.049191+0000 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 17 (quincy) 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2024-09-10T21:05:04.052 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-10T21:05:04.053 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-09-10T21:05:04.053 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-10T21:05:04.053 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T21:05:04.055 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T21:05:04.089 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 65dcb08a-1e46-42c5-ba37-fc802a6ee031... 2024-09-10T21:05:04.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T21:05:04.133 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T21:05:04.226 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-09-10T21:05:04.226 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T21:05:04.227 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-09-10T21:05:04.228 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2024-09-10T21:05:04.229 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 65dcb08a-1e46-42c5-ba37-fc802a6ee031 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-09-10T21:05:04.230 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug trim objects = true 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.231 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 20 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 20 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 10 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-09-10T21:05:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 30 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-10T21:05:04.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.234 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon down mkfs grace = 300 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T21:05:04.235 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2024-09-10T21:05:04.236 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2024-09-10T21:05:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T21:05:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.100,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 65dcb08a-1e46-42c5-ba37-fc802a6ee031 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.239 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug trim objects = true 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 20 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 20 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 10 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.242 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: client mount timeout = 30 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2024-09-10T21:05:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T21:05:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: mon down mkfs grace = 300 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2024-09-10T21:05:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = "" 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2024-09-10T21:05:04.246 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2024-09-10T21:05:04.256 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T21:05:04.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T21:05:04.353 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T21:05:04.353 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:04.354 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T21:05:04.388 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:04.388 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T21:05:04.463 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:05:04.463 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:04.463 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T21:05:04.463 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T21:05:04.581 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:04.581 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:04.657 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:05:04.657 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:04.657 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T21:05:04.657 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T21:05:04.735 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:04.736 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:04.811 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T21:05:04.811 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T21:05:04.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T21:05:04.914 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T21:05:04.920 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T21:05:05.028 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T21:05:05.034 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T21:05:05.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T21:05:05.139 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T21:05:05.144 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T21:05:05.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T21:05:05.302 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T21:05:05.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T21:05:05.363 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T21:05:05.468 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T21:05:05.473 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T21:05:05.530 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T21:05:05.632 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T21:05:05.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T21:05:05.693 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T21:05:05.693 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T21:05:05.774 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T21:05:05.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T21:05:05.882 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T21:05:05.909 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T21:05:05.991 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T21:05:06.018 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T21:05:06.099 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T21:05:06.126 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T21:05:06.127 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T21:05:06.127 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T21:05:06.183 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:06.183 INFO:tasks.ceph:role: osd.0 2024-09-10T21:05:06.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:05:06.183 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T21:05:06.245 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T21:05:06.246 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T21:05:06.648 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-10T21:05:06.652 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-10T21:05:06.652 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T21:05:06.786 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T21:05:06.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T21:05:06.905 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:06.905 INFO:tasks.ceph:role: osd.1 2024-09-10T21:05:06.905 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:05:06.905 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T21:05:06.967 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T21:05:06.967 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T21:05:06.968 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T21:05:06.968 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T21:05:06.968 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T21:05:06.968 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-10T21:05:06.968 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T21:05:06.968 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T21:05:06.968 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T21:05:06.968 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T21:05:07.326 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-10T21:05:07.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-10T21:05:07.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T21:05:07.414 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T21:05:07.477 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T21:05:07.532 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:07.532 INFO:tasks.ceph:role: osd.2 2024-09-10T21:05:07.532 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:05:07.532 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T21:05:07.594 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T21:05:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T21:05:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T21:05:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T21:05:07.594 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T21:05:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-10T21:05:07.594 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T21:05:07.594 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T21:05:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T21:05:07.595 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T21:05:07.977 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-10T21:05:07.980 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-10T21:05:07.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T21:05:08.078 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T21:05:08.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T21:05:08.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:08.195 INFO:tasks.ceph:role: osd.3 2024-09-10T21:05:08.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:05:08.195 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T21:05:08.258 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T21:05:08.258 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T21:05:08.259 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T21:05:08.259 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T21:05:08.259 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T21:05:08.259 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-10T21:05:08.259 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T21:05:08.259 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T21:05:08.260 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T21:05:08.260 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T21:05:08.685 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-10T21:05:08.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-10T21:05:08.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T21:05:08.828 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T21:05:08.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:08.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:08.988+0000 7f28a943e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T21:05:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:08.992+0000 7f28a943e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T21:05:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:08.992+0000 7f28a943e640 -1 bdev(0x5557e855b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T21:05:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:08.992+0000 7f28a943e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T21:05:12.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T21:05:12.079 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:12.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:12.164+0000 7f3392327640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T21:05:12.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:12.164+0000 7f3392327640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T21:05:12.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:12.164+0000 7f3392327640 -1 bdev(0x561dcfdaf800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T21:05:12.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:12.165+0000 7f3392327640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T21:05:15.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T21:05:15.241 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:15.328+0000 7f87f722c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T21:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:15.329+0000 7f87f722c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T21:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:15.329+0000 7f87f722c640 -1 bdev(0x55f694339800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T21:05:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:15.329+0000 7f87f722c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T21:05:18.348 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T21:05:18.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:18.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:18.493+0000 7f9c9d40c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T21:05:18.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:18.493+0000 7f9c9d40c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T21:05:18.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:18.493+0000 7f9c9d40c640 -1 bdev(0x5586a095b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T21:05:18.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:18.494+0000 7f9c9d40c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T21:05:21.514 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T21:05:21.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T21:05:21.633 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:21.634 INFO:tasks.ceph:role: osd.4 2024-09-10T21:05:21.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:05:21.634 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T21:05:21.700 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T21:05:21.700 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T21:05:21.700 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T21:05:21.700 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T21:05:21.700 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T21:05:21.700 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-09-10T21:05:21.700 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T21:05:21.701 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T21:05:21.701 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T21:05:21.701 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T21:05:22.109 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-09-10T21:05:22.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-09-10T21:05:22.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T21:05:22.237 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T21:05:22.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T21:05:22.357 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:22.357 INFO:tasks.ceph:role: osd.5 2024-09-10T21:05:22.358 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:05:22.358 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T21:05:22.421 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T21:05:22.421 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T21:05:22.421 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T21:05:22.421 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T21:05:22.421 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T21:05:22.421 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-09-10T21:05:22.422 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T21:05:22.422 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T21:05:22.422 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T21:05:22.422 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T21:05:22.778 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-09-10T21:05:22.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-09-10T21:05:22.782 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T21:05:22.867 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T21:05:22.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T21:05:22.985 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:22.986 INFO:tasks.ceph:role: osd.6 2024-09-10T21:05:22.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:05:22.986 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T21:05:23.048 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T21:05:23.048 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T21:05:23.048 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T21:05:23.049 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T21:05:23.049 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T21:05:23.049 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-09-10T21:05:23.049 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T21:05:23.049 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T21:05:23.049 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T21:05:23.049 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T21:05:23.441 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-09-10T21:05:23.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-09-10T21:05:23.445 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T21:05:23.537 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T21:05:23.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T21:05:23.655 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T21:05:23.656 INFO:tasks.ceph:role: osd.7 2024-09-10T21:05:23.656 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:05:23.656 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T21:05:23.718 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T21:05:23.718 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T21:05:23.718 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T21:05:23.719 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T21:05:23.719 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T21:05:23.719 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-09-10T21:05:23.719 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T21:05:23.719 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T21:05:23.719 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T21:05:23.719 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T21:05:24.132 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-09-10T21:05:24.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-09-10T21:05:24.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T21:05:24.269 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T21:05:24.332 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:24.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:24.430+0000 7f48bcea5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T21:05:24.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:24.433+0000 7f48bcea5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T21:05:24.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:24.433+0000 7f48bcea5640 -1 bdev(0x5620d1cff800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T21:05:24.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:24.434+0000 7f48bcea5640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T21:05:27.442 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T21:05:27.502 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:27.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:27.592+0000 7fc438a12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T21:05:27.596 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:27.592+0000 7fc438a12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T21:05:27.596 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:27.592+0000 7fc438a12640 -1 bdev(0x557362077800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T21:05:27.596 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:27.593+0000 7fc438a12640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T21:05:30.610 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T21:05:30.666 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:30.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:30.752+0000 7f95e9e13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T21:05:30.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:30.753+0000 7f95e9e13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T21:05:30.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:30.753+0000 7f95e9e13640 -1 bdev(0x564896197800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T21:05:30.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:30.753+0000 7f95e9e13640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T21:05:31.775 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:05:31.780 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:05:33.791 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T21:05:33.851 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:33.944 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:33.940+0000 7f639ad89640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T21:05:33.944 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:33.940+0000 7f639ad89640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T21:05:33.944 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:33.941+0000 7f639ad89640 -1 bdev(0x557dc7813800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T21:05:33.944 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:33.941+0000 7f639ad89640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T21:05:37.192 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T21:05:37.249 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T21:05:37.249 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:37.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T21:05:37.312 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:37.312 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T21:05:37.411 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:37.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T21:05:37.507 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:37.507 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T21:05:37.602 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:37.602 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T21:05:37.697 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:37.698 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T21:05:37.793 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:37.793 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T21:05:37.888 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:37.888 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T21:05:37.947 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:37.947 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T21:05:38.044 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:38.044 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T21:05:38.140 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:38.140 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T21:05:38.236 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:38.237 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T21:05:38.331 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:38.331 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T21:05:38.426 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:38.426 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T21:05:38.522 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:38.522 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T21:05:38.557 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:38.558 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T21:05:38.632 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:38.632 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T21:05:38.667 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:38.667 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T21:05:38.741 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T21:05:38.742 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T21:05:38.745 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T21:05:38.793 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-09-10T21:05:38.793 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCAtOBmnUJZNhAA3FfByeaPqqDV3QVkKICf7Q== 2024-09-10T21:05:38.793 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-09-10T21:05:38.793 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBm91YfCBAAJuQU3vTj6NDAS79wnMTRvg== 2024-09-10T21:05:38.793 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-09-10T21:05:38.793 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBmgcrhERAAO2cvVbfzenrSfeNN10k1Gg== 2024-09-10T21:05:38.793 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-09-10T21:05:38.793 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCEtOBmqN8EOxAAFD8DdBAhlxn+wHTxNFHqCg== 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCItOBmLHTkCRAAQkyehe+jK3Nl9eNCyPVGwg== 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCLtOBmXvevExAAKvSylSs/T/RLeUUg6sFpQA== 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCOtOBmxD19HRAA5/CNRhr7PVJovwbTUJ5P+g== 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBmsY1/ARAAIwtbNAaOYqOu1yYJg5RGkQ== 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBmQeXDGxAAvPmL7yT75FSOxR5oiJBzyw== 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBmgLeIJRAA5p1iud1IbSMCy4qrVJeXoA== 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-09-10T21:05:38.794 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCUtOBm7IiuGRAAPTBvPcz/MVGaN9bZ7Olaiw== 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCXtOBm1hBTIxAA3QNXf0whNBdat8tpsEhiyg== 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCatOBmWN7lLBAACDaIR2pwIBHTk2D2DcxkpQ== 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCdtOBmNvUVOBAAMlTy+S1hKSdWT1E0/QuPmQ== 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBmKe35LRAA/ypsjneLjq8SDPXWynEDQw== 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout:[client.2] 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBmacJtNBAAb0YQ3rXAS1ABoMXN4y0xoA== 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBmO5rsOhAAC8hEhtjNT9/IFDrWMaMe6A== 2024-09-10T21:05:38.795 INFO:teuthology.orchestra.run.smithi100.stdout:[client.3] 2024-09-10T21:05:38.796 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCCtOBmBfXHBRAABuclnXQOigqnoLze1rkrAw== 2024-09-10T21:05:38.833 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2024-09-10T21:05:38.833 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCAtOBmnUJZNhAA3FfByeaPqqDV3QVkKICf7Q== 2024-09-10T21:05:38.833 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2024-09-10T21:05:38.833 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCBtOBm91YfCBAAJuQU3vTj6NDAS79wnMTRvg== 2024-09-10T21:05:38.833 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2024-09-10T21:05:38.833 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCBtOBmgcrhERAAO2cvVbfzenrSfeNN10k1Gg== 2024-09-10T21:05:38.833 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCEtOBmqN8EOxAAFD8DdBAhlxn+wHTxNFHqCg== 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCItOBmLHTkCRAAQkyehe+jK3Nl9eNCyPVGwg== 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCLtOBmXvevExAAKvSylSs/T/RLeUUg6sFpQA== 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCOtOBmxD19HRAA5/CNRhr7PVJovwbTUJ5P+g== 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCBtOBmsY1/ARAAIwtbNAaOYqOu1yYJg5RGkQ== 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCBtOBmQeXDGxAAvPmL7yT75FSOxR5oiJBzyw== 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCBtOBmgLeIJRAA5p1iud1IbSMCy4qrVJeXoA== 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2024-09-10T21:05:38.834 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCUtOBm7IiuGRAAPTBvPcz/MVGaN9bZ7Olaiw== 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCXtOBm1hBTIxAA3QNXf0whNBdat8tpsEhiyg== 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCatOBmWN7lLBAACDaIR2pwIBHTk2D2DcxkpQ== 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCdtOBmNvUVOBAAMlTy+S1hKSdWT1E0/QuPmQ== 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCBtOBmKe35LRAA/ypsjneLjq8SDPXWynEDQw== 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout:[client.2] 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCBtOBmacJtNBAAb0YQ3rXAS1ABoMXN4y0xoA== 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCBtOBmO5rsOhAAC8hEhtjNT9/IFDrWMaMe6A== 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout:[client.3] 2024-09-10T21:05:38.835 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCCtOBmBfXHBRAABuclnXQOigqnoLze1rkrAw== 2024-09-10T21:05:38.836 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T21:05:38.840 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T21:05:38.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T21:05:38.974 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T21:05:39.069 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T21:05:39.073 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T21:05:39.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.173 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.265 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.269 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.362 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.458 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T21:05:39.559 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T21:05:39.651 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T21:05:39.655 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T21:05:39.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T21:05:39.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T21:05:39.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.855 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:39.954 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:40.047 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:40.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:40.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:40.149 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T21:05:40.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T21:05:40.246 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T21:05:40.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T21:05:40.347 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T21:05:40.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T21:05:40.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T21:05:40.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T21:05:40.548 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T21:05:40.644 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T21:05:40.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T21:05:40.700 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T21:05:40.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T21:05:40.863 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T21:05:40.919 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T21:05:41.027 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T21:05:41.083 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T21:05:41.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T21:05:41.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T21:05:41.303 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:41.307 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T21:05:41.341 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T21:05:41.341 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T21:05:41.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T21:05:41.382 INFO:tasks.ceph.mon.a:Started 2024-09-10T21:05:41.382 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T21:05:41.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T21:05:41.386 INFO:tasks.ceph.mon.b:Started 2024-09-10T21:05:41.386 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T21:05:41.387 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T21:05:41.391 INFO:tasks.ceph.mon.c:Started 2024-09-10T21:05:41.391 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T21:05:41.391 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T21:05:41.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T21:05:41.394 INFO:tasks.ceph.mgr.y:Started 2024-09-10T21:05:41.395 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T21:05:41.395 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T21:05:41.398 INFO:tasks.ceph.mgr.x:Started 2024-09-10T21:05:41.398 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-10T21:05:41.399 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-10T21:05:41.402 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-10T21:05:41.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-10T21:05:41.449 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-10T21:05:41.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-10T21:05:41.496 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-10T21:05:41.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-10T21:05:41.543 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-10T21:05:41.543 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-10T21:05:41.589 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-10T21:05:41.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-10T21:05:41.637 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-10T21:05:41.637 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-10T21:05:41.684 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-10T21:05:41.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-10T21:05:41.738 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-10T21:05:41.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-10T21:05:41.747 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-10T21:05:41.747 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-10T21:05:41.795 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-10T21:05:41.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-10T21:05:41.851 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-10T21:05:41.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-10T21:05:41.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.846+0000 7fb08aa00640 1 -- 172.21.15.100:0/3974125667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0980d0bb0 msgr2=0x7fb0981f7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.846+0000 7fb08aa00640 1 --2- 172.21.15.100:0/3974125667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0980d0bb0 0x7fb0981f7c10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00ea20 tx=0x7fb08c00eee0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.846+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a814c150 con 0x7fd0a80cea90 2024-09-10T21:05:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.847+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a814c710 con 0x7fd0a80cea90 2024-09-10T21:05:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.847+0000 7fd09f400640 1 -- 172.21.15.100:0/872790128 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd090004b90 con 0x7fd0a80cea90 2024-09-10T21:05:41.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.847+0000 7fd09f400640 1 -- 172.21.15.100:0/872790128 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd09001a4f0 con 0x7fd0a80cea90 2024-09-10T21:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.849+0000 7fb08aa00640 1 -- 172.21.15.100:0/3974125667 shutdown_connections 2024-09-10T21:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.849+0000 7fb08aa00640 1 --2- 172.21.15.100:0/3974125667 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb0981615f0 0x7fb0981f86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.849+0000 7fb08aa00640 1 --2- 172.21.15.100:0/3974125667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb098161210 0x7fb09809f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.849+0000 7fb08aa00640 1 --2- 172.21.15.100:0/3974125667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0980d0bb0 0x7fb0981f7c10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.849+0000 7fb08aa00640 1 -- 172.21.15.100:0/3974125667 >> 172.21.15.100:0/3974125667 conn(0x7fb0980d3d10 msgr2=0x7fb0980b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.849+0000 7fb08aa00640 1 -- 172.21.15.100:0/3974125667 shutdown_connections 2024-09-10T21:05:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.850+0000 7fb08aa00640 1 -- 172.21.15.100:0/3974125667 wait complete. 2024-09-10T21:05:41.870 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-10T21:05:41.870 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-10T21:05:41.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.863+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a80ce550 con 0x7fd0a80cea90 2024-09-10T21:05:41.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.867+0000 7fd09f400640 1 -- 172.21.15.100:0/872790128 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fd090010530 con 0x7fd0a80cea90 2024-09-10T21:05:41.886 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T21:05:41.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-10T21:05:41.895 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T21:05:41.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-10T21:05:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.912+0000 7f41f4800640 1 -- 172.21.15.100:0/3765390489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80deda0 msgr2=0x7f41e80529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.912+0000 7f41f4800640 1 --2- 172.21.15.100:0/3765390489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80deda0 0x7f41e80529f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009830 tx=0x7f41dc02a2e0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.923 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-10T21:05:41.923 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-10T21:05:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.917+0000 7f41f4800640 1 -- 172.21.15.100:0/3765390489 shutdown_connections 2024-09-10T21:05:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.917+0000 7f41f4800640 1 --2- 172.21.15.100:0/3765390489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80deda0 0x7f41e80529f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.917+0000 7f41f4800640 1 -- 172.21.15.100:0/3765390489 >> 172.21.15.100:0/3765390489 conn(0x7f41e801d950 msgr2=0x7f41e8054740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.920+0000 7f41f4800640 1 -- 172.21.15.100:0/3765390489 shutdown_connections 2024-09-10T21:05:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.920+0000 7f41f4800640 1 -- 172.21.15.100:0/3765390489 wait complete. 2024-09-10T21:05:41.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.927+0000 7f41f4800640 1 Processor -- start 2024-09-10T21:05:41.938 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T21:05:41.938 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T21:05:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.927+0000 7f41f4800640 1 -- start start 2024-09-10T21:05:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.932+0000 7f41f4800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e8007170 0x7f41e8174940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.932+0000 7f41f4800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80de9c0 0x7f41e80e1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.932+0000 7f41f4800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41e80deda0 0x7f41e804d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.934+0000 7f41f1e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41e80deda0 0x7f41e804d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.934+0000 7f41f1e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41e80deda0 0x7f41e804d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:54500/0 (socket says 172.21.15.100:54500) 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.934+0000 7f41f1e00640 1 -- 172.21.15.100:0/3309859772 learned_addr learned my addr 172.21.15.100:0/3309859772 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.934+0000 7f41f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e8007170 0x7f41e8174940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.934+0000 7f41f4800640 1 -- 172.21.15.100:0/3309859772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8053310 con 0x7f41e80de9c0 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.934+0000 7f41f4800640 1 -- 172.21.15.100:0/3309859772 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8053190 con 0x7f41e8007170 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.934+0000 7f41f4800640 1 -- 172.21.15.100:0/3309859772 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f41e8053490 con 0x7f41e80deda0 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.935+0000 7f41f0a00640 1 --2- 172.21.15.100:0/3309859772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80de9c0 0x7f41e80e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.935+0000 7f41f0a00640 1 -- 172.21.15.100:0/3309859772 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41e80deda0 msgr2=0x7f41e804d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.935+0000 7f41f0a00640 1 --2- 172.21.15.100:0/3309859772 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41e80deda0 0x7f41e804d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.935+0000 7f41f0a00640 1 -- 172.21.15.100:0/3309859772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e8007170 msgr2=0x7f41e8174940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.935+0000 7f41f0a00640 1 --2- 172.21.15.100:0/3309859772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e8007170 0x7f41e8174940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.935+0000 7f41f0a00640 1 -- 172.21.15.100:0/3309859772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e817ecb0 con 0x7f41e80de9c0 2024-09-10T21:05:41.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.936+0000 7f41f0a00640 1 --2- 172.21.15.100:0/3309859772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80de9c0 0x7f41e80e1010 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41e000c500 tx=0x7f41e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:41.948 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-10T21:05:41.948 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-10T21:05:41.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.937+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0017070 con 0x7f41e80de9c0 2024-09-10T21:05:41.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.937+0000 7f41f4800640 1 -- 172.21.15.100:0/3309859772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e817ef90 con 0x7f41e80de9c0 2024-09-10T21:05:41.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.937+0000 7f41f4800640 1 -- 172.21.15.100:0/3309859772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e80e0810 con 0x7f41e80de9c0 2024-09-10T21:05:41.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.941+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f41e00035f0 con 0x7f41e80de9c0 2024-09-10T21:05:41.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.941+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0021060 con 0x7f41e80de9c0 2024-09-10T21:05:41.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.943+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f41e0003b00 con 0x7f41e80de9c0 2024-09-10T21:05:41.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.943+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f41e0012760 con 0x7f41e80de9c0 2024-09-10T21:05:41.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.943+0000 7f41db400640 1 -- 172.21.15.100:0/3309859772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e80529f0 con 0x7f41e80de9c0 2024-09-10T21:05:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:41.954+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f41e00129b0 con 0x7f41e80de9c0 2024-09-10T21:05:41.965 DEBUG:tasks.ceph:set 18 configs 2024-09-10T21:05:41.965 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi100') 2024-09-10T21:05:41.966 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi100') 2024-09-10T21:05:41.966 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi100') 2024-09-10T21:05:41.966 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.009+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1154826395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d801d700 msgr2=0x7fa1d8007210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.009+0000 7fa1dfe00640 1 --2- 172.21.15.100:0/1154826395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d801d700 0x7fa1d8007210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800cc10 tx=0x7fa1cc02a440 comp rx=0 tx=0).stop 2024-09-10T21:05:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.011+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1154826395 shutdown_connections 2024-09-10T21:05:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.011+0000 7fa1dfe00640 1 --2- 172.21.15.100:0/1154826395 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1d8037c50 0x7fa1d80380c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.011+0000 7fa1dfe00640 1 --2- 172.21.15.100:0/1154826395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d801d700 0x7fa1d8007210 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800cc10 tx=0x7fa1cc02a440 comp rx=0 tx=0).stop 2024-09-10T21:05:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.011+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1154826395 >> 172.21.15.100:0/1154826395 conn(0x7fa1d80511c0 msgr2=0x7fa1d80515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.008+0000 7fa802c00640 1 -- 172.21.15.100:0/935600561 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fa7d0005100 con 0x7fa7f4005a60 2024-09-10T21:05:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.013+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1154826395 shutdown_connections 2024-09-10T21:05:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.017+0000 7fa7efe00640 1 -- 172.21.15.100:0/935600561 <== mon.2 v2:172.21.15.130:3301/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fa7f003ca40 con 0x7fa7f4005a60 2024-09-10T21:05:42.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.020+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f41e0012bb0 con 0x7f41e80de9c0 2024-09-10T21:05:42.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.013+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1154826395 wait complete. 2024-09-10T21:05:42.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.015+0000 7fa1dfe00640 1 Processor -- start 2024-09-10T21:05:42.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.023+0000 7fa1dfe00640 1 -- start start 2024-09-10T21:05:42.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.025+0000 7fa7efe00640 1 -- 172.21.15.100:0/935600561 <== mon.2 v2:172.21.15.130:3301/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7fa7f0040030 con 0x7fa7f4005a60 2024-09-10T21:05:42.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.025+0000 7fd09f400640 1 -- 172.21.15.100:0/872790128 <== mon.2 v2:172.21.15.130:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fd090010820 con 0x7fd0a80cea90 2024-09-10T21:05:42.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.031+0000 7fa1dfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80361c0 0x7fa1d8047480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.031+0000 7fa1dfe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1d8037c50 0x7fa1d8048440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.034+0000 7fa1dfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1d8049aa0 0x7fa1d8048980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.034+0000 7fa1dfe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d800a230 con 0x7fa1d80361c0 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.034+0000 7fa1dfe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d800bdf0 con 0x7fa1d8049aa0 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.034+0000 7fa1dfe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d800a3b0 con 0x7fa1d8037c50 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.034+0000 7fa1e5e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1d8049aa0 0x7fa1d8048980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.034+0000 7fa1e5e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1d8049aa0 0x7fa1d8048980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:54806/0 (socket says 172.21.15.100:54806) 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.034+0000 7fa1e5e00640 1 -- 172.21.15.100:0/1412826327 learned_addr learned my addr 172.21.15.100:0/1412826327 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.034+0000 7fa1dea00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80361c0 0x7fa1d8047480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.036+0000 7fa802c00640 1 -- 172.21.15.100:0/935600561 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7f4005a60 msgr2=0x7fa7f4168d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.036+0000 7fa802c00640 1 --2- 172.21.15.100:0/935600561 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7f4005a60 0x7fa7f4168d60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000aa80 tx=0x7fa7f00046c0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.035+0000 7fa1e5e00640 1 -- 172.21.15.100:0/1412826327 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1d8037c50 msgr2=0x7fa1d8048440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:05:42.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.035+0000 7fa1e5e00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1d8037c50 0x7fa1d8048440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.035+0000 7fa1e5e00640 1 -- 172.21.15.100:0/1412826327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80361c0 msgr2=0x7fa1d8047480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.039+0000 7fa1e5e00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80361c0 0x7fa1d8047480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.039+0000 7fa1e5e00640 1 -- 172.21.15.100:0/1412826327 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d80d8a30 con 0x7fa1d8049aa0 2024-09-10T21:05:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.039+0000 7fa1e5e00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1d8049aa0 0x7fa1d8048980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa1e006c1a0 tx=0x7fa1e0069cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.039+0000 7fa1dea00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80361c0 0x7fa1d8047480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:05:42.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.042+0000 7fa802c00640 1 -- 172.21.15.100:0/935600561 shutdown_connections 2024-09-10T21:05:42.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.042+0000 7fa802c00640 1 --2- 172.21.15.100:0/935600561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7f40366f0 0x7fa7f40216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.042+0000 7fa802c00640 1 --2- 172.21.15.100:0/935600561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7f401c890 0x7fa7f40de4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.042+0000 7fa802c00640 1 --2- 172.21.15.100:0/935600561 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7f4005a60 0x7fa7f4168d60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.042+0000 7fa802c00640 1 -- 172.21.15.100:0/935600561 >> 172.21.15.100:0/935600561 conn(0x7fa7f4054560 msgr2=0x7fa7f4037e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.043+0000 7fa802c00640 1 -- 172.21.15.100:0/935600561 shutdown_connections 2024-09-10T21:05:42.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.040+0000 7fa1d7400640 1 -- 172.21.15.100:0/1412826327 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0075840 con 0x7fa1d8049aa0 2024-09-10T21:05:42.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.040+0000 7fa1d7400640 1 -- 172.21.15.100:0/1412826327 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fa1e0075c90 con 0x7fa1d8049aa0 2024-09-10T21:05:42.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.040+0000 7fa1d7400640 1 -- 172.21.15.100:0/1412826327 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0076040 con 0x7fa1d8049aa0 2024-09-10T21:05:42.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.044+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d80d8d10 con 0x7fa1d8049aa0 2024-09-10T21:05:42.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.044+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d80d92d0 con 0x7fa1d8049aa0 2024-09-10T21:05:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.054+0000 7fa802c00640 1 -- 172.21.15.100:0/935600561 wait complete. 2024-09-10T21:05:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.054+0000 7fa1d7400640 1 -- 172.21.15.100:0/1412826327 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa1e009b030 con 0x7fa1d8049aa0 2024-09-10T21:05:42.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.054+0000 7fa1d7400640 1 -- 172.21.15.100:0/1412826327 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa1e0093cc0 con 0x7fa1d8049aa0 2024-09-10T21:05:42.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.056+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b8005290 con 0x7fa1d8049aa0 2024-09-10T21:05:42.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.059+0000 7fa1d7400640 1 -- 172.21.15.100:0/1412826327 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa1e008f030 con 0x7fa1d8049aa0 2024-09-10T21:05:42.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.129+0000 7f0ca5800640 1 -- 172.21.15.100:0/2541282201 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 msgr2=0x7f0ca00b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.129+0000 7f0ca5800640 1 --2- 172.21.15.100:0/2541282201 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 0x7f0ca00b28b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0c90005fd0 tx=0x7f0c9003b4e0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.136+0000 7f0ca5800640 1 -- 172.21.15.100:0/2541282201 shutdown_connections 2024-09-10T21:05:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.136+0000 7f0ca5800640 1 --2- 172.21.15.100:0/2541282201 >> v2:172.21.15.100:3300/0 conn(0x7f0ca0162530 0x7f0ca00d2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.136+0000 7f0ca5800640 1 --2- 172.21.15.100:0/2541282201 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 0x7f0ca00b28b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.136+0000 7f0ca5800640 1 -- 172.21.15.100:0/2541282201 >> 172.21.15.100:0/2541282201 conn(0x7f0ca00d3c50 msgr2=0x7f0ca00d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.138+0000 7f0ca5800640 1 -- 172.21.15.100:0/2541282201 shutdown_connections 2024-09-10T21:05:42.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.138+0000 7f0ca5800640 1 -- 172.21.15.100:0/2541282201 wait complete. 2024-09-10T21:05:42.145 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.146+0000 7f0ca5800640 1 Processor -- start 2024-09-10T21:05:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.146+0000 7f0ca5800640 1 -- start start 2024-09-10T21:05:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.147+0000 7f0ca5800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 0x7f0ca00d0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.147+0000 7f0ca5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ca0162110 0x7f0ca00d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.147+0000 7f0ca5800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ca0162530 0x7f0ca008b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.151+0000 7f0c9ea00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 0x7f0ca00d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.151+0000 7f0c9f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ca0162530 0x7f0ca008b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.151+0000 7f0c9ea00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 0x7f0ca00d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:54542/0 (socket says 172.21.15.100:54542) 2024-09-10T21:05:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.152+0000 7f0c9e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ca0162110 0x7f0ca00d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.156+0000 7f0c9e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ca0162110 0x7f0ca00d0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50306/0 (socket says 172.21.15.100:50306) 2024-09-10T21:05:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.152+0000 7f0c9f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ca0162530 0x7f0ca008b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:54824/0 (socket says 172.21.15.100:54824) 2024-09-10T21:05:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.156+0000 7f0c9ea00640 1 -- 172.21.15.100:0/243063438 learned_addr learned my addr 172.21.15.100:0/243063438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.156+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca00d0370 con 0x7f0ca0162110 2024-09-10T21:05:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.156+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca00d29b0 con 0x7f0ca0162530 2024-09-10T21:05:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.156+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca00d04f0 con 0x7f0ca0161d30 2024-09-10T21:05:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.157+0000 7f0c9e000640 1 -- 172.21.15.100:0/243063438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 msgr2=0x7f0ca00d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.157+0000 7f0c9e000640 1 --2- 172.21.15.100:0/243063438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 0x7f0ca00d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.157+0000 7f0c9e000640 1 -- 172.21.15.100:0/243063438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ca0162530 msgr2=0x7f0ca008b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.157+0000 7f0c9e000640 1 --2- 172.21.15.100:0/243063438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ca0162530 0x7f0ca008b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.157+0000 7f0c9e000640 1 -- 172.21.15.100:0/243063438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca0155f90 con 0x7f0ca0162110 2024-09-10T21:05:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.158+0000 7f0c9e000640 1 --2- 172.21.15.100:0/243063438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ca0162110 0x7f0ca00d0e60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009fd0 tx=0x7f0c8c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.158+0000 7f0c96a00640 1 -- 172.21.15.100:0/243063438 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c015020 con 0x7f0ca0162110 2024-09-10T21:05:42.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.158+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca00b40d0 con 0x7f0ca0162110 2024-09-10T21:05:42.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.159+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca00b4910 con 0x7f0ca0162110 2024-09-10T21:05:42.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.159+0000 7fb5b4a00640 1 -- 172.21.15.100:0/3196389811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5b00aef60 msgr2=0x7fb5b016ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.159+0000 7fb5b4a00640 1 --2- 172.21.15.100:0/3196389811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5b00aef60 0x7fb5b016ab20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0071d50 tx=0x7fb59c02b150 comp rx=0 tx=0).stop 2024-09-10T21:05:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.165+0000 7fb5b4a00640 1 -- 172.21.15.100:0/3196389811 shutdown_connections 2024-09-10T21:05:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.165+0000 7fb5b4a00640 1 --2- 172.21.15.100:0/3196389811 >> v2:172.21.15.100:3300/0 conn(0x7fb5b016b060 0x7fb5b006f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.165+0000 7fb5b4a00640 1 --2- 172.21.15.100:0/3196389811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5b00aef60 0x7fb5b016ab20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.165+0000 7fb5b4a00640 1 -- 172.21.15.100:0/3196389811 >> 172.21.15.100:0/3196389811 conn(0x7fb5b006cb50 msgr2=0x7fb5b006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.165+0000 7fb5b4a00640 1 -- 172.21.15.100:0/3196389811 shutdown_connections 2024-09-10T21:05:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.166+0000 7fb5b4a00640 1 -- 172.21.15.100:0/3196389811 wait complete. 2024-09-10T21:05:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.166+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fd0a815f520 con 0x7fd0a80cea90 2024-09-10T21:05:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.164+0000 7f0c96a00640 1 -- 172.21.15.100:0/243063438 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f0c8c011900 con 0x7f0ca0162110 2024-09-10T21:05:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.164+0000 7f0c96a00640 1 -- 172.21.15.100:0/243063438 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c015020 con 0x7f0ca0162110 2024-09-10T21:05:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.165+0000 7f0c96a00640 1 -- 172.21.15.100:0/243063438 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0c8c01a400 con 0x7f0ca0162110 2024-09-10T21:05:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.165+0000 7f0c96a00640 1 -- 172.21.15.100:0/243063438 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0c8c019860 con 0x7f0ca0162110 2024-09-10T21:05:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.168+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c78005290 con 0x7f0ca0162110 2024-09-10T21:05:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.176+0000 7fb5b4a00640 1 Processor -- start 2024-09-10T21:05:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.177+0000 7fb5b4a00640 1 -- start start 2024-09-10T21:05:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.182+0000 7fb5b4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b006fb70 0x7fb5b015f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.183+0000 7fb5b4a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5b00aef60 0x7fb5b016c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.183+0000 7fb5b4a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5b016b060 0x7fb5b016cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.183+0000 7fb5b4a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00cf600 con 0x7fb5b006fb70 2024-09-10T21:05:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.183+0000 7fb5b4a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00aed20 con 0x7fb5b00aef60 2024-09-10T21:05:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.183+0000 7fb5b4a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b00cf780 con 0x7fb5b016b060 2024-09-10T21:05:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5afe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5b016b060 0x7fb5b016cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5afe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5b016b060 0x7fb5b016cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:54554/0 (socket says 172.21.15.100:54554) 2024-09-10T21:05:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5afe00640 1 -- 172.21.15.100:0/2807549566 learned_addr learned my addr 172.21.15.100:0/2807549566 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5aea00640 1 --2- 172.21.15.100:0/2807549566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5b00aef60 0x7fb5b016c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5afe00640 1 -- 172.21.15.100:0/2807549566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5b00aef60 msgr2=0x7fb5b016c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.186+0000 7f0c96a00640 1 -- 172.21.15.100:0/243063438 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0c8c01f020 con 0x7f0ca0162110 2024-09-10T21:05:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5afe00640 1 --2- 172.21.15.100:0/2807549566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5b00aef60 0x7fb5b016c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5afe00640 1 -- 172.21.15.100:0/2807549566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b006fb70 msgr2=0x7fb5b015f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5afe00640 1 --2- 172.21.15.100:0/2807549566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b006fb70 0x7fb5b015f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.184+0000 7fb5afe00640 1 -- 172.21.15.100:0/2807549566 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b02058e0 con 0x7fb5b016b060 2024-09-10T21:05:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.188+0000 7fb5afe00640 1 --2- 172.21.15.100:0/2807549566 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5b016b060 0x7fb5b016cc20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800c780 tx=0x7fb5a800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.189+0000 7fb5a7400640 1 -- 172.21.15.100:0/2807549566 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8017070 con 0x7fb5b016b060 2024-09-10T21:05:42.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.193+0000 7fb5a7400640 1 -- 172.21.15.100:0/2807549566 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb5a8005070 con 0x7fb5b016b060 2024-09-10T21:05:42.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.193+0000 7fb5a7400640 1 -- 172.21.15.100:0/2807549566 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80054e0 con 0x7fb5b016b060 2024-09-10T21:05:42.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.193+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b00c46f0 con 0x7fb5b016b060 2024-09-10T21:05:42.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.193+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b0204e00 con 0x7fb5b016b060 2024-09-10T21:05:42.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.198+0000 7fb5a7400640 1 -- 172.21.15.100:0/2807549566 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb5a8006b10 con 0x7fb5b016b060 2024-09-10T21:05:42.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.202+0000 7fb5a7400640 1 -- 172.21.15.100:0/2807549566 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb5a800ad50 con 0x7fb5b016b060 2024-09-10T21:05:42.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.204+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b006d7e0 con 0x7fb5b016b060 2024-09-10T21:05:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.204+0000 7fd09f400640 1 -- 172.21.15.100:0/872790128 <== mon.2 v2:172.21.15.130:3301/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd090010ae0 con 0x7fd0a80cea90 2024-09-10T21:05:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.204+0000 7fb5a7400640 1 -- 172.21.15.100:0/2807549566 <== mon.2 v2:172.21.15.130:3301/0 6 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5a8007020 con 0x7fb5b016b060 2024-09-10T21:05:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.205+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41e0012e40 con 0x7f41e80de9c0 2024-09-10T21:05:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.205+0000 7f0c96a00640 1 -- 172.21.15.100:0/243063438 <== mon.0 v2:172.21.15.100:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c8c0193b0 con 0x7f0ca0162110 2024-09-10T21:05:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.205+0000 7fa1d7400640 1 -- 172.21.15.100:0/1412826327 <== mon.1 v2:172.21.15.130:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1e00761e0 con 0x7fa1d8049aa0 2024-09-10T21:05:42.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.207+0000 7fd09f400640 1 -- 172.21.15.100:0/872790128 <== mon.2 v2:172.21.15.130:3301/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fd09001a6f0 con 0x7fd0a80cea90 2024-09-10T21:05:42.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.207+0000 7fb5a7400640 1 -- 172.21.15.100:0/2807549566 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fb5b006d7e0 con 0x7fb5b016b060 2024-09-10T21:05:42.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.209+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a80cea90 msgr2=0x7fd0a814cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.209+0000 7fd0ad000640 1 --2- 172.21.15.100:0/872790128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a80cea90 0x7fd0a814cf10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd09000c540 tx=0x7fd09000ca00 comp rx=0 tx=0).stop 2024-09-10T21:05:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.213+0000 7f41db400640 1 -- 172.21.15.100:0/3309859772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f41c40052f0 con 0x7f41e80de9c0 2024-09-10T21:05:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.217+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 shutdown_connections 2024-09-10T21:05:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.217+0000 7fd0ad000640 1 --2- 172.21.15.100:0/872790128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0a8161810 0x7fd0a80c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.217+0000 7fd0ad000640 1 --2- 172.21.15.100:0/872790128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a80d4560 0x7fd0a814b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.217+0000 7fd0ad000640 1 --2- 172.21.15.100:0/872790128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a80cea90 0x7fd0a814cf10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.217+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 >> 172.21.15.100:0/872790128 conn(0x7fd0a80d3a40 msgr2=0x7fd0a814db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.217+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 shutdown_connections 2024-09-10T21:05:42.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.218+0000 7fd0ad000640 1 -- 172.21.15.100:0/872790128 wait complete. 2024-09-10T21:05:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.222+0000 7f41e6000640 1 -- 172.21.15.100:0/3309859772 <== mon.0 v2:172.21.15.100:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f41e00070f0 con 0x7f41e80de9c0 2024-09-10T21:05:42.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.228+0000 7f41db400640 1 -- 172.21.15.100:0/3309859772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80de9c0 msgr2=0x7f41e80e1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.228+0000 7f41db400640 1 --2- 172.21.15.100:0/3309859772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80de9c0 0x7f41e80e1010 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41e000c500 tx=0x7f41e000c9c0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.233+0000 7f35a9200640 1 -- 172.21.15.100:0/445121698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3588004800 msgr2=0x7f3588004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.233+0000 7f35a9200640 1 --2- 172.21.15.100:0/445121698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3588004800 0x7f3588004c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3590009d00 tx=0x7f3588005830 comp rx=0 tx=0).stop 2024-09-10T21:05:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f41db400640 1 -- 172.21.15.100:0/3309859772 shutdown_connections 2024-09-10T21:05:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f41db400640 1 --2- 172.21.15.100:0/3309859772 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41e80deda0 0x7f41e804d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f41db400640 1 --2- 172.21.15.100:0/3309859772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e80de9c0 0x7f41e80e1010 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f41db400640 1 --2- 172.21.15.100:0/3309859772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41e8007170 0x7f41e8174940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f41db400640 1 -- 172.21.15.100:0/3309859772 >> 172.21.15.100:0/3309859772 conn(0x7f41e801d950 msgr2=0x7f41e8047660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f41db400640 1 -- 172.21.15.100:0/3309859772 shutdown_connections 2024-09-10T21:05:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f35a9200640 1 -- 172.21.15.100:0/445121698 shutdown_connections 2024-09-10T21:05:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f35a9200640 1 --2- 172.21.15.100:0/445121698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3588004800 0x7f3588004c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f35a9200640 1 -- 172.21.15.100:0/445121698 >> 172.21.15.100:0/445121698 conn(0x7f35a406cb50 msgr2=0x7f35a406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.234+0000 7f41db400640 1 -- 172.21.15.100:0/3309859772 wait complete. 2024-09-10T21:05:42.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.235+0000 7f35a9200640 1 -- 172.21.15.100:0/445121698 shutdown_connections 2024-09-10T21:05:42.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.235+0000 7f35a9200640 1 -- 172.21.15.100:0/445121698 wait complete. 2024-09-10T21:05:42.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.237+0000 7f35a9200640 1 Processor -- start 2024-09-10T21:05:42.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.245+0000 7f35a9200640 1 -- start start 2024-09-10T21:05:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.251+0000 7f35a9200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3588004800 0x7f35a40ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.252+0000 7f35a9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a4201670 0x7f35a4201af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.252+0000 7f35a9200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f35a40ab5d0 0x7f35a40aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.252+0000 7f35a9200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f35a40cfe50 con 0x7f35a4201670 2024-09-10T21:05:42.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.252+0000 7f35a9200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35a40cfcd0 con 0x7f3588004800 2024-09-10T21:05:42.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.252+0000 7f35a9200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f35a40cffd0 con 0x7f35a40ab5d0 2024-09-10T21:05:42.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.254+0000 7f35a3e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f35a40ab5d0 0x7f35a40aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.255+0000 7f35a3e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f35a40ab5d0 0x7f35a40aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:54568/0 (socket says 172.21.15.100:54568) 2024-09-10T21:05:42.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.255+0000 7f35a3e00640 1 -- 172.21.15.100:0/1121157481 learned_addr learned my addr 172.21.15.100:0/1121157481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.256+0000 7f35a3e00640 1 -- 172.21.15.100:0/1121157481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3588004800 msgr2=0x7f35a40ac610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:05:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.256+0000 7f35a3e00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3588004800 0x7f35a40ac610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.256+0000 7f35a3e00640 1 -- 172.21.15.100:0/1121157481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a4201670 msgr2=0x7f35a4201af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:05:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.261+0000 7f35a2a00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a4201670 0x7f35a4201af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.261+0000 7f35a3e00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a4201670 0x7f35a4201af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.261+0000 7f35a3e00640 1 -- 172.21.15.100:0/1121157481 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a40aa530 con 0x7f35a40ab5d0 2024-09-10T21:05:42.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.261+0000 7f35a3e00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f35a40ab5d0 0x7f35a40aba50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35a4075730 tx=0x7f359400e6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.266 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.262+0000 7f359b400640 1 -- 172.21.15.100:0/1121157481 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594015070 con 0x7f35a40ab5d0 2024-09-10T21:05:42.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.262+0000 7f359b400640 1 -- 172.21.15.100:0/1121157481 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3594011460 con 0x7f35a40ab5d0 2024-09-10T21:05:42.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.262+0000 7f359b400640 1 -- 172.21.15.100:0/1121157481 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940118d0 con 0x7f35a40ab5d0 2024-09-10T21:05:42.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.262+0000 7f35a9200640 1 -- 172.21.15.100:0/1121157481 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a40aa810 con 0x7f35a40ab5d0 2024-09-10T21:05:42.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.262+0000 7f35a9200640 1 -- 172.21.15.100:0/1121157481 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a40aadd0 con 0x7f35a40ab5d0 2024-09-10T21:05:42.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.263+0000 7f359b400640 1 -- 172.21.15.100:0/1121157481 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f3594011a70 con 0x7f35a40ab5d0 2024-09-10T21:05:42.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.263+0000 7f359b400640 1 -- 172.21.15.100:0/1121157481 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3594010700 con 0x7f35a40ab5d0 2024-09-10T21:05:42.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.265+0000 7f35a2a00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a4201670 0x7f35a4201af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:05:42.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.266+0000 7f35a9200640 1 -- 172.21.15.100:0/1121157481 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357c005290 con 0x7f35a40ab5d0 2024-09-10T21:05:42.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.271+0000 7f359b400640 1 -- 172.21.15.100:0/1121157481 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f3594010900 con 0x7f35a40ab5d0 2024-09-10T21:05:42.296 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.303+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fa1b8005580 con 0x7fa1d8049aa0 2024-09-10T21:05:42.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.316+0000 7fa1d7400640 1 -- 172.21.15.100:0/1412826327 <== mon.1 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7fa1e008f030 con 0x7fa1d8049aa0 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.319+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1d8049aa0 msgr2=0x7fa1d8048980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.319+0000 7fa1dfe00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1d8049aa0 0x7fa1d8048980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa1e006c1a0 tx=0x7fa1e0069cc0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.319+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 shutdown_connections 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.319+0000 7fa1dfe00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1d8049aa0 0x7fa1d8048980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.319+0000 7fa1dfe00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1d8037c50 0x7fa1d8048440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.319+0000 7fa1dfe00640 1 --2- 172.21.15.100:0/1412826327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80361c0 0x7fa1d8047480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.319+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 >> 172.21.15.100:0/1412826327 conn(0x7fa1d80511c0 msgr2=0x7fa1d80065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.320+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 shutdown_connections 2024-09-10T21:05:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.320+0000 7fa1dfe00640 1 -- 172.21.15.100:0/1412826327 wait complete. 2024-09-10T21:05:42.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.361+0000 7f06fd000640 1 -- 172.21.15.100:0/4291112688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f80d4560 msgr2=0x7f06f8162130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.362+0000 7f06fd000640 1 --2- 172.21.15.100:0/4291112688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f80d4560 0x7f06f8162130 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f06f808c780 tx=0x7f06e403b540 comp rx=0 tx=0).stop 2024-09-10T21:05:42.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.362+0000 7f06fd000640 1 -- 172.21.15.100:0/4291112688 shutdown_connections 2024-09-10T21:05:42.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.362+0000 7f06fd000640 1 --2- 172.21.15.100:0/4291112688 >> v2:172.21.15.100:3300/0 conn(0x7f06f815c460 0x7f06f815c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.362+0000 7f06fd000640 1 --2- 172.21.15.100:0/4291112688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f80d4560 0x7f06f8162130 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.362+0000 7f06fd000640 1 --2- 172.21.15.100:0/4291112688 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06f8161810 0x7f06f8161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.362+0000 7f06fd000640 1 -- 172.21.15.100:0/4291112688 >> 172.21.15.100:0/4291112688 conn(0x7f06f80d3a40 msgr2=0x7f06f80d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.362+0000 7f06fd000640 1 -- 172.21.15.100:0/4291112688 shutdown_connections 2024-09-10T21:05:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.362+0000 7f06fd000640 1 -- 172.21.15.100:0/4291112688 wait complete. 2024-09-10T21:05:42.367 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.364+0000 7f06fd000640 1 Processor -- start 2024-09-10T21:05:42.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.365+0000 7f06fd000640 1 -- start start 2024-09-10T21:05:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.366+0000 7f67f4e00640 1 -- 172.21.15.100:0/142195296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67d4003a70 msgr2=0x7f67d4003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.366+0000 7f67f4e00640 1 --2- 172.21.15.100:0/142195296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67d4003a70 0x7f67d4003e90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009b50 tx=0x7f67d4005830 comp rx=0 tx=0).stop 2024-09-10T21:05:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.367+0000 7f67efe00640 1 -- 172.21.15.100:0/142195296 reap_dead start 2024-09-10T21:05:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.367+0000 7f67f4e00640 1 -- 172.21.15.100:0/142195296 shutdown_connections 2024-09-10T21:05:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.367+0000 7f67f4e00640 1 -- 172.21.15.100:0/142195296 >> 172.21.15.100:0/142195296 conn(0x7f67f006cb50 msgr2=0x7f67f006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f67f4e00640 1 -- 172.21.15.100:0/142195296 shutdown_connections 2024-09-10T21:05:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f67f4e00640 1 -- 172.21.15.100:0/142195296 wait complete. 2024-09-10T21:05:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.367+0000 7f06fd000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06f80d4560 0x7f06f814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.367+0000 7f06fd000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f815c460 0x7f06f8154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.367+0000 7f06fd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06f8161810 0x7f06f80c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f06f7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06f8161810 0x7f06f80c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f06f7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06f8161810 0x7f06f80c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50388/0 (socket says 172.21.15.100:50388) 2024-09-10T21:05:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f06f6a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f815c460 0x7f06f8154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f06f7e00640 1 -- 172.21.15.100:0/362954379 learned_addr learned my addr 172.21.15.100:0/362954379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06f80ce6d0 con 0x7f06f8161810 2024-09-10T21:05:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06f80ce550 con 0x7f06f815c460 2024-09-10T21:05:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f06f80ce850 con 0x7f06f80d4560 2024-09-10T21:05:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.368+0000 7f06f7400640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06f80d4560 0x7f06f814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.369+0000 7f06f6a00640 1 -- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06f80d4560 msgr2=0x7f06f814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.369+0000 7f06f6a00640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06f80d4560 0x7f06f814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.369+0000 7f06f6a00640 1 -- 172.21.15.100:0/362954379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06f8161810 msgr2=0x7f06f80c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.369+0000 7f06f6a00640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06f8161810 0x7f06f80c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.369+0000 7f06f6a00640 1 -- 172.21.15.100:0/362954379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f8153870 con 0x7f06f815c460 2024-09-10T21:05:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.369+0000 7f06f7400640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06f80d4560 0x7f06f814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:05:42.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.373+0000 7f06f6a00640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f815c460 0x7f06f8154310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f06e4042000 tx=0x7f06e4004b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.373+0000 7f06ef400640 1 -- 172.21.15.100:0/362954379 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4046030 con 0x7f06f815c460 2024-09-10T21:05:42.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.373+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f8157180 con 0x7f06f815c460 2024-09-10T21:05:42.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.373+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f8157460 con 0x7f06f815c460 2024-09-10T21:05:42.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.374+0000 7f06ef400640 1 -- 172.21.15.100:0/362954379 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06e4004030 con 0x7f06f815c460 2024-09-10T21:05:42.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.374+0000 7f06ef400640 1 -- 172.21.15.100:0/362954379 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4046030 con 0x7f06f815c460 2024-09-10T21:05:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.375+0000 7f06ef400640 1 -- 172.21.15.100:0/362954379 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f06e40035f0 con 0x7f06f815c460 2024-09-10T21:05:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.375+0000 7f06ef400640 1 -- 172.21.15.100:0/362954379 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f06e4019070 con 0x7f06f815c460 2024-09-10T21:05:42.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.374+0000 7f67f4e00640 1 Processor -- start 2024-09-10T21:05:42.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.379+0000 7f52af200640 1 -- 172.21.15.100:0/3510645805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52940053c0 msgr2=0x7f5294005990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.379+0000 7f52af200640 1 --2- 172.21.15.100:0/3510645805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52940053c0 0x7f5294005990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009f90 tx=0x7f5294005830 comp rx=0 tx=0).stop 2024-09-10T21:05:42.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.379+0000 7f52af200640 1 -- 172.21.15.100:0/3510645805 shutdown_connections 2024-09-10T21:05:42.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.379+0000 7f52af200640 1 --2- 172.21.15.100:0/3510645805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52940053c0 0x7f5294005990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.379+0000 7f52af200640 1 -- 172.21.15.100:0/3510645805 >> 172.21.15.100:0/3510645805 conn(0x7f52b00b1480 msgr2=0x7f52b00b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.379+0000 7f52af200640 1 -- 172.21.15.100:0/3510645805 shutdown_connections 2024-09-10T21:05:42.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.379+0000 7f52af200640 1 -- 172.21.15.100:0/3510645805 wait complete. 2024-09-10T21:05:42.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.381+0000 7f67f4e00640 1 -- start start 2024-09-10T21:05:42.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.384+0000 7f67f4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67d4003a70 0x7f67f01fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.385+0000 7f67ef400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67d4003a70 0x7f67f01fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.385+0000 7f67ef400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67d4003a70 0x7f67f01fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50398/0 (socket says 172.21.15.100:50398) 2024-09-10T21:05:42.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.385+0000 7f67ef400640 1 -- 172.21.15.100:0/3587739751 learned_addr learned my addr 172.21.15.100:0/3587739751 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.385+0000 7f67f4e00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67f01566a0 0x7f67f014eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.385+0000 7f67f4e00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f015de90 0x7f67f015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.386+0000 7f67eea00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67f01566a0 0x7f67f014eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.386+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67f0161690 con 0x7f67d4003a70 2024-09-10T21:05:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.386+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67f00b3610 con 0x7f67f01566a0 2024-09-10T21:05:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.386+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f67f0161810 con 0x7f67f015de90 2024-09-10T21:05:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.386+0000 7f67efe00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f015de90 0x7f67f015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.387+0000 7f67efe00640 1 -- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67f01566a0 msgr2=0x7f67f014eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.387+0000 7f67efe00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67f01566a0 0x7f67f014eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.387+0000 7f67efe00640 1 -- 172.21.15.100:0/3587739751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67d4003a70 msgr2=0x7f67f01fb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.387+0000 7f6aee200640 1 -- 172.21.15.100:0/2471192566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad0004d40 msgr2=0x7f6ad00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.387+0000 7f6aee200640 1 --2- 172.21.15.100:0/2471192566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ad0004d40 0x7f6ad00051c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009fb0 tx=0x7f6ad0005830 comp rx=0 tx=0).stop 2024-09-10T21:05:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.388+0000 7f6ae7400640 1 -- 172.21.15.100:0/2471192566 reap_dead start 2024-09-10T21:05:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.388+0000 7f6aee200640 1 -- 172.21.15.100:0/2471192566 shutdown_connections 2024-09-10T21:05:42.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.388+0000 7f6aee200640 1 -- 172.21.15.100:0/2471192566 >> 172.21.15.100:0/2471192566 conn(0x7f6ae80b1380 msgr2=0x7f6ae80b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.389+0000 7f6aee200640 1 -- 172.21.15.100:0/2471192566 shutdown_connections 2024-09-10T21:05:42.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.389+0000 7f6aee200640 1 -- 172.21.15.100:0/2471192566 wait complete. 2024-09-10T21:05:42.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.390+0000 7f67efe00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67d4003a70 0x7f67f01fb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.390+0000 7f67efe00640 1 -- 172.21.15.100:0/3587739751 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f0156b20 con 0x7f67f015de90 2024-09-10T21:05:42.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.390+0000 7f67eea00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67f01566a0 0x7f67f014eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:05:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.390+0000 7f67ef400640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67d4003a70 0x7f67f01fb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:05:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.390+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d0005290 con 0x7f06f815c460 2024-09-10T21:05:42.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.393+0000 7f6aee200640 1 Processor -- start 2024-09-10T21:05:42.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.391+0000 7f52af200640 1 Processor -- start 2024-09-10T21:05:42.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.395+0000 7f52af200640 1 -- start start 2024-09-10T21:05:42.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.396+0000 7f06ef400640 1 -- 172.21.15.100:0/362954379 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f06e404f020 con 0x7f06f815c460 2024-09-10T21:05:42.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.393+0000 7f6aee200640 1 -- start start 2024-09-10T21:05:42.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.395+0000 7f6aee200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae814fd20 0x7f6ae80c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.395+0000 7f6aee200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae8153600 0x7f6ae81fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.395+0000 7f6aee200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae81fc150 0x7f6ae8157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.395+0000 7f6aee200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae80b1ff0 con 0x7f6ae81fc150 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.395+0000 7f6aee200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae80b1e70 con 0x7f6ae814fd20 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.395+0000 7f6aee200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae80cc630 con 0x7f6ae8153600 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.396+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae81fc150 0x7f6ae8157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.396+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae81fc150 0x7f6ae8157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50406/0 (socket says 172.21.15.100:50406) 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.396+0000 7f6ae7400640 1 -- 172.21.15.100:0/1608816719 learned_addr learned my addr 172.21.15.100:0/1608816719 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.396+0000 7f6ae7400640 1 -- 172.21.15.100:0/1608816719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae8153600 msgr2=0x7f6ae81fbc10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.396+0000 7f6ae7400640 1 --2- 172.21.15.100:0/1608816719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae8153600 0x7f6ae81fbc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.396+0000 7f6ae7400640 1 -- 172.21.15.100:0/1608816719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae814fd20 msgr2=0x7f6ae80c2820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:05:42.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.396+0000 7f6ae7400640 1 --2- 172.21.15.100:0/1608816719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae814fd20 0x7f6ae80c2820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.397+0000 7f6ae7400640 1 -- 172.21.15.100:0/1608816719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae80b3d70 con 0x7f6ae81fc150 2024-09-10T21:05:42.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.398+0000 7f6ae7400640 1 --2- 172.21.15.100:0/1608816719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae81fc150 0x7f6ae8157c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009f00 tx=0x7f6adc003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.399+0000 7f6adb400640 1 -- 172.21.15.100:0/1608816719 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc044070 con 0x7f6ae81fc150 2024-09-10T21:05:42.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.399+0000 7f6adb400640 1 -- 172.21.15.100:0/1608816719 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6adc003fd0 con 0x7f6ae81fc150 2024-09-10T21:05:42.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.399+0000 7f6adb400640 1 -- 172.21.15.100:0/1608816719 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc031040 con 0x7f6ae81fc150 2024-09-10T21:05:42.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.400+0000 7f6aee200640 1 -- 172.21.15.100:0/1608816719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae8152840 con 0x7f6ae81fc150 2024-09-10T21:05:42.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.401+0000 7f6aee200640 1 -- 172.21.15.100:0/1608816719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae8152e00 con 0x7f6ae81fc150 2024-09-10T21:05:42.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.403+0000 7f6adb400640 1 -- 172.21.15.100:0/1608816719 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f6adc03e070 con 0x7f6ae81fc150 2024-09-10T21:05:42.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.404+0000 7f6adb400640 1 -- 172.21.15.100:0/1608816719 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6adc049a70 con 0x7f6ae81fc150 2024-09-10T21:05:42.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.404+0000 7f6ad8c00640 1 -- 172.21.15.100:0/1608816719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6abc005290 con 0x7f6ae81fc150 2024-09-10T21:05:42.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.405+0000 7f52af200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52940053c0 0x7f52b0146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.405+0000 7f52af200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52b0149000 0x7f52b0149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.406+0000 7f52ade00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52940053c0 0x7f52b0146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.406+0000 7f52af200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b00cd950 0x7f52b00cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.409+0000 7f52ad400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52b0149000 0x7f52b0149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.409+0000 7f52ad400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52b0149000 0x7f52b0149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:54646/0 (socket says 172.21.15.100:54646) 2024-09-10T21:05:42.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.409+0000 7f52ade00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52940053c0 0x7f52b0146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50420/0 (socket says 172.21.15.100:50420) 2024-09-10T21:05:42.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.410+0000 7f6adb400640 1 -- 172.21.15.100:0/1608816719 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f6adc04e020 con 0x7f6ae81fc150 2024-09-10T21:05:42.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.411+0000 7f52ae800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b00cd950 0x7f52b00cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.413+0000 7f52ae800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b00cd950 0x7f52b00cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:54936/0 (socket says 172.21.15.100:54936) 2024-09-10T21:05:42.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.413+0000 7f52af200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52b015db00 con 0x7f52940053c0 2024-09-10T21:05:42.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.413+0000 7f52af200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52b015d980 con 0x7f52b00cd950 2024-09-10T21:05:42.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.413+0000 7f52af200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f52b015dc80 con 0x7f52b0149000 2024-09-10T21:05:42.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.413+0000 7f52ad400640 1 -- 172.21.15.100:0/2862811034 learned_addr learned my addr 172.21.15.100:0/2862811034 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.416+0000 7f52ade00640 1 -- 172.21.15.100:0/2862811034 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52b0149000 msgr2=0x7f52b0149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.416+0000 7f52ade00640 1 --2- 172.21.15.100:0/2862811034 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52b0149000 0x7f52b0149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.416+0000 7f52ade00640 1 -- 172.21.15.100:0/2862811034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b00cd950 msgr2=0x7f52b00cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.416+0000 7f52ade00640 1 --2- 172.21.15.100:0/2862811034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b00cd950 0x7f52b00cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.416+0000 7f52ade00640 1 -- 172.21.15.100:0/2862811034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b0146780 con 0x7f52940053c0 2024-09-10T21:05:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.417+0000 7f52ad400640 1 --2- 172.21.15.100:0/2862811034 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52b0149000 0x7f52b0149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.416+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f0c78005850 con 0x7f0ca0162110 2024-09-10T21:05:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.417+0000 7f52ade00640 1 --2- 172.21.15.100:0/2862811034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52940053c0 0x7f52b0146240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f52a000e6e0 tx=0x7f52a000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7f52a6000640 1 -- 172.21.15.100:0/2862811034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a000ccc0 con 0x7f52940053c0 2024-09-10T21:05:42.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7f52a6000640 1 -- 172.21.15.100:0/2862811034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52a000ce60 con 0x7f52940053c0 2024-09-10T21:05:42.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7f52a6000640 1 -- 172.21.15.100:0/2862811034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0010690 con 0x7f52940053c0 2024-09-10T21:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7fbad0c00640 1 -- 172.21.15.100:0/187761016 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b270 msgr2=0x7fbacc0ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7fbad0c00640 1 --2- 172.21.15.100:0/187761016 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b270 0x7fbacc0ad850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbab8005fd0 tx=0x7fbab802a540 comp rx=0 tx=0).stop 2024-09-10T21:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7fbad0c00640 1 -- 172.21.15.100:0/187761016 shutdown_connections 2024-09-10T21:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7fbad0c00640 1 --2- 172.21.15.100:0/187761016 >> v2:172.21.15.130:3300/0 conn(0x7fbacc08b650 0x7fbacc0739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7fbad0c00640 1 --2- 172.21.15.100:0/187761016 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b270 0x7fbacc0ad850 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7fbad0c00640 1 -- 172.21.15.100:0/187761016 >> 172.21.15.100:0/187761016 conn(0x7fbacc06d180 msgr2=0x7fbacc0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7fbad0c00640 1 -- 172.21.15.100:0/187761016 shutdown_connections 2024-09-10T21:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.419+0000 7fbad0c00640 1 -- 172.21.15.100:0/187761016 wait complete. 2024-09-10T21:05:42.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.419+0000 7f974a000640 1 -- 172.21.15.100:0/3599305674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 msgr2=0x7f973c0e68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.419+0000 7f974a000640 1 --2- 172.21.15.100:0/3599305674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 0x7f973c0e68c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f974406b2c0 tx=0x7f97440a59c0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.420+0000 7f974a000640 1 -- 172.21.15.100:0/3599305674 shutdown_connections 2024-09-10T21:05:42.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.420+0000 7f974a000640 1 --2- 172.21.15.100:0/3599305674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 0x7f973c0e68c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.420+0000 7f974a000640 1 --2- 172.21.15.100:0/3599305674 >> v2:172.21.15.130:3300/0 conn(0x7f973c03e690 0x7f973c037dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.420+0000 7f974a000640 1 -- 172.21.15.100:0/3599305674 >> 172.21.15.100:0/3599305674 conn(0x7f973c03a3d0 msgr2=0x7f973c03a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.420+0000 7f974a000640 1 -- 172.21.15.100:0/3599305674 shutdown_connections 2024-09-10T21:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.421+0000 7f974a000640 1 -- 172.21.15.100:0/3599305674 wait complete. 2024-09-10T21:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.418+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b0149ba0 con 0x7f52940053c0 2024-09-10T21:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.419+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b01fc0a0 con 0x7f52940053c0 2024-09-10T21:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.420+0000 7f52a6000640 1 -- 172.21.15.100:0/2862811034 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f52a0010bc0 con 0x7f52940053c0 2024-09-10T21:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.420+0000 7f52a6000640 1 -- 172.21.15.100:0/2862811034 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f52a00052e0 con 0x7f52940053c0 2024-09-10T21:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.422+0000 7fbad0c00640 1 Processor -- start 2024-09-10T21:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.423+0000 7fbad0c00640 1 -- start start 2024-09-10T21:05:42.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.423+0000 7f974a000640 1 Processor -- start 2024-09-10T21:05:42.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.423+0000 7f0c96a00640 1 -- 172.21.15.100:0/243063438 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v9)=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f0c8c01f020 con 0x7f0ca0162110 2024-09-10T21:05:42.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.424+0000 7f974a000640 1 -- start start 2024-09-10T21:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7fbad0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbacc08b270 0x7fbacc168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ca0162110 msgr2=0x7f0ca00d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f0ca5800640 1 --2- 172.21.15.100:0/243063438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ca0162110 0x7f0ca00d0e60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009fd0 tx=0x7f0c8c00b870 comp rx=0 tx=0).stop 2024-09-10T21:05:42.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7fbad0c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b650 0x7fbacc0b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f974a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c053de0 0x7f973c04b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b00ce310 con 0x7f52940053c0 2024-09-10T21:05:42.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7fbad0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbacc16fc80 0x7fbacc0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f974a000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 0x7f973c0e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 shutdown_connections 2024-09-10T21:05:42.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f0ca5800640 1 --2- 172.21.15.100:0/243063438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ca0162530 0x7f0ca008b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f0ca5800640 1 --2- 172.21.15.100:0/243063438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ca0162110 0x7f0ca00d0e60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f0ca5800640 1 --2- 172.21.15.100:0/243063438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ca0161d30 0x7f0ca00d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 >> 172.21.15.100:0/243063438 conn(0x7f0ca00d3c50 msgr2=0x7f0ca00d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.426+0000 7f974a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f973c006fa0 0x7f973c1893b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7f974a000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f973c0570b0 con 0x7f973c053de0 2024-09-10T21:05:42.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7f9749600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f973c006fa0 0x7f973c1893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7f9749600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f973c006fa0 0x7f973c1893b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:54972/0 (socket says 172.21.15.100:54972) 2024-09-10T21:05:42.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7f9749600640 1 -- 172.21.15.100:0/2988215071 learned_addr learned my addr 172.21.15.100:0/2988215071 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f973c056f30 con 0x7f973c006fa0 2024-09-10T21:05:42.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7f9743e00640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 0x7f973c0e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f973c057230 con 0x7f973c0e6430 2024-09-10T21:05:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7fbac9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b650 0x7fbacc0b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.427+0000 7fbac9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b650 0x7fbacc0b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:54698/0 (socket says 172.21.15.100:54698) 2024-09-10T21:05:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7fbac9400640 1 -- 172.21.15.100:0/3031972643 learned_addr learned my addr 172.21.15.100:0/3031972643 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7f9749600640 1 -- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 msgr2=0x7f973c0e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7f9749600640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 0x7f973c0e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7f9749600640 1 -- 172.21.15.100:0/2988215071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c053de0 msgr2=0x7f973c04b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7f9749600640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c053de0 0x7f973c04b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7f9749600640 1 -- 172.21.15.100:0/2988215071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c0062f0 con 0x7f973c006fa0 2024-09-10T21:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7f9743e00640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 0x7f973c0e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7fbaca800640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbacc16fc80 0x7fbacc0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.428+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc0740b0 con 0x7fbacc08b270 2024-09-10T21:05:42.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.429+0000 7f9749600640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f973c006fa0 0x7f973c1893b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f97440661a0 tx=0x7f974406b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.429+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc073f30 con 0x7fbacc16fc80 2024-09-10T21:05:42.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.429+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbacc074230 con 0x7fbacc08b650 2024-09-10T21:05:42.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.429+0000 7f9740c00640 1 -- 172.21.15.100:0/2988215071 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97440ae040 con 0x7f973c006fa0 2024-09-10T21:05:42.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.429+0000 7fbac9e00640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbacc08b270 0x7fbacc168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.429+0000 7f9740c00640 1 -- 172.21.15.100:0/2988215071 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97440aa930 con 0x7f973c006fa0 2024-09-10T21:05:42.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.429+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c18a010 con 0x7f973c006fa0 2024-09-10T21:05:42.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.429+0000 7f9740c00640 1 -- 172.21.15.100:0/2988215071 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97440aad20 con 0x7f973c006fa0 2024-09-10T21:05:42.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.430+0000 7fbac9e00640 1 -- 172.21.15.100:0/3031972643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b650 msgr2=0x7fbacc0b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.431+0000 7fbac9e00640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b650 0x7fbacc0b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.431+0000 7fbac9e00640 1 -- 172.21.15.100:0/3031972643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbacc16fc80 msgr2=0x7fbacc0b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.431+0000 7fbac9e00640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbacc16fc80 0x7fbacc0b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.431+0000 7fbac9e00640 1 -- 172.21.15.100:0/3031972643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc2066d0 con 0x7fbacc08b270 2024-09-10T21:05:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.431+0000 7fbac9400640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b650 0x7fbacc0b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:05:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.432+0000 7fbac9e00640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbacc08b270 0x7fbacc168d50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbab8031000 tx=0x7fbab8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.432+0000 7f52a6000640 1 -- 172.21.15.100:0/2862811034 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f52a0026070 con 0x7f52940053c0 2024-09-10T21:05:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.432+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 shutdown_connections 2024-09-10T21:05:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.432+0000 7f0ca5800640 1 -- 172.21.15.100:0/243063438 wait complete. 2024-09-10T21:05:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.433+0000 7fbac2000640 1 -- 172.21.15.100:0/3031972643 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab803f070 con 0x7fbacc08b270 2024-09-10T21:05:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.433+0000 7fbac2000640 1 -- 172.21.15.100:0/3031972643 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbab8004d20 con 0x7fbacc08b270 2024-09-10T21:05:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.433+0000 7fbac2000640 1 -- 172.21.15.100:0/3031972643 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8035030 con 0x7fbacc08b270 2024-09-10T21:05:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.433+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbacc166140 con 0x7fbacc08b270 2024-09-10T21:05:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.434+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbacc166700 con 0x7fbacc08b270 2024-09-10T21:05:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.430+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c0e3980 con 0x7f973c006fa0 2024-09-10T21:05:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.432+0000 7f9740c00640 1 -- 172.21.15.100:0/2988215071 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f97440bb070 con 0x7f973c006fa0 2024-09-10T21:05:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.433+0000 7f9740c00640 1 -- 172.21.15.100:0/2988215071 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f97440b3420 con 0x7f973c006fa0 2024-09-10T21:05:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.433+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f973c037dc0 con 0x7f973c006fa0 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.435+0000 7f2203a00640 1 -- 172.21.15.100:0/4145644649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21fc072990 msgr2=0x7f21fc163760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.435+0000 7f2203a00640 1 --2- 172.21.15.100:0/4145644649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21fc072990 0x7f21fc163760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005fd0 tx=0x7f21f402a8a0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.436+0000 7f2203a00640 1 -- 172.21.15.100:0/4145644649 shutdown_connections 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.436+0000 7f2203a00640 1 --2- 172.21.15.100:0/4145644649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21fc072990 0x7f21fc163760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.437+0000 7f2203a00640 1 --2- 172.21.15.100:0/4145644649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21fc0b4560 0x7f21fc072450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.437+0000 7f2203a00640 1 -- 172.21.15.100:0/4145644649 >> 172.21.15.100:0/4145644649 conn(0x7f21fc06cb50 msgr2=0x7f21fc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.437+0000 7f2203a00640 1 -- 172.21.15.100:0/4145644649 shutdown_connections 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.437+0000 7f2203a00640 1 -- 172.21.15.100:0/4145644649 wait complete. 2024-09-10T21:05:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.437+0000 7fbac2000640 1 -- 172.21.15.100:0/3031972643 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fbab8004ef0 con 0x7fbacc08b270 2024-09-10T21:05:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.437+0000 7fbac2000640 1 -- 172.21.15.100:0/3031972643 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbab803bb40 con 0x7fbacc08b270 2024-09-10T21:05:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.438+0000 7f702d400640 1 -- 172.21.15.100:0/548959824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f702001c8c0 msgr2=0x7f702001cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.438+0000 7f702d400640 1 --2- 172.21.15.100:0/548959824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f702001c8c0 0x7f702001cca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f702806b2c0 tx=0x7f70280a6570 comp rx=0 tx=0).stop 2024-09-10T21:05:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.439+0000 7f702d400640 1 -- 172.21.15.100:0/548959824 shutdown_connections 2024-09-10T21:05:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.439+0000 7f702d400640 1 --2- 172.21.15.100:0/548959824 >> v2:172.21.15.100:3300/0 conn(0x7f7020005a90 0x7f7020036010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.439+0000 7f702d400640 1 --2- 172.21.15.100:0/548959824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f702001c8c0 0x7f702001cca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.439+0000 7f702d400640 1 -- 172.21.15.100:0/548959824 >> 172.21.15.100:0/548959824 conn(0x7f7020054590 msgr2=0x7f7020054970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.440+0000 7f9740c00640 1 -- 172.21.15.100:0/2988215071 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f97440bd860 con 0x7f973c006fa0 2024-09-10T21:05:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.441+0000 7f702d400640 1 -- 172.21.15.100:0/548959824 shutdown_connections 2024-09-10T21:05:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.441+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbacc0ad850 con 0x7fbacc08b270 2024-09-10T21:05:42.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.442+0000 7f2203a00640 1 Processor -- start 2024-09-10T21:05:42.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.442+0000 7f2203a00640 1 -- start start 2024-09-10T21:05:42.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.444+0000 7f2203a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21fc072990 0x7f21fc1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.444+0000 7f2203a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21fc0b4560 0x7f21fc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.444+0000 7f2203a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21fc1651d0 0x7f21fc0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.445+0000 7f2201a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21fc1651d0 0x7f21fc0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.445+0000 7f2201a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21fc1651d0 0x7f21fc0cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:54728/0 (socket says 172.21.15.100:54728) 2024-09-10T21:05:42.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.445+0000 7f2201a00640 1 -- 172.21.15.100:0/1340191455 learned_addr learned my addr 172.21.15.100:0/1340191455 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.446+0000 7f21fbe00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21fc0b4560 0x7f21fc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.445+0000 7f2203a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc164030 con 0x7f21fc072990 2024-09-10T21:05:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.446+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc163eb0 con 0x7f21fc0b4560 2024-09-10T21:05:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.446+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc1641b0 con 0x7f21fc1651d0 2024-09-10T21:05:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.447+0000 7f21fbe00640 1 -- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21fc1651d0 msgr2=0x7f21fc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.447+0000 7f21fbe00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21fc1651d0 0x7f21fc0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.447+0000 7f21fbe00640 1 -- 172.21.15.100:0/1340191455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21fc072990 msgr2=0x7f21fc1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.447+0000 7f21fbe00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21fc072990 0x7f21fc1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.448+0000 7f21fbe00640 1 -- 172.21.15.100:0/1340191455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc156310 con 0x7f21fc0b4560 2024-09-10T21:05:42.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.448+0000 7f2201a00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21fc1651d0 0x7f21fc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:42.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.448+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fb5b00cfc00 con 0x7fb5b016b060 2024-09-10T21:05:42.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.442+0000 7f702d400640 1 -- 172.21.15.100:0/548959824 wait complete. 2024-09-10T21:05:42.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.444+0000 7f702d400640 1 Processor -- start 2024-09-10T21:05:42.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.448+0000 7f21fbe00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21fc0b4560 0x7f21fc0ccf00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0ae7b0 tx=0x7f21f000db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.448+0000 7f21f8c00640 1 -- 172.21.15.100:0/1340191455 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0017070 con 0x7f21fc0b4560 2024-09-10T21:05:42.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.449+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21fc1565f0 con 0x7f21fc0b4560 2024-09-10T21:05:42.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.449+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21fc156e90 con 0x7f21fc0b4560 2024-09-10T21:05:42.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.449+0000 7f21f8c00640 1 -- 172.21.15.100:0/1340191455 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f0005310 con 0x7f21fc0b4560 2024-09-10T21:05:42.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.449+0000 7f21f8c00640 1 -- 172.21.15.100:0/1340191455 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0009820 con 0x7f21fc0b4560 2024-09-10T21:05:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.451+0000 7fbac2000640 1 -- 172.21.15.100:0/3031972643 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fbab803bd90 con 0x7fbacc08b270 2024-09-10T21:05:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.451+0000 7f21f8c00640 1 -- 172.21.15.100:0/1340191455 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f21f00099c0 con 0x7f21fc0b4560 2024-09-10T21:05:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.451+0000 7f21f8c00640 1 -- 172.21.15.100:0/1340191455 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f21f0010670 con 0x7f21fc0b4560 2024-09-10T21:05:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.451+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d8005290 con 0x7f21fc0b4560 2024-09-10T21:05:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.455+0000 7f21f8c00640 1 -- 172.21.15.100:0/1340191455 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f21f00047a0 con 0x7f21fc0b4560 2024-09-10T21:05:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.451+0000 7f702d400640 1 -- start start 2024-09-10T21:05:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.456+0000 7f702d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7020005a90 0x7f7020185a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.456+0000 7f702d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f702001c8c0 0x7f70200de240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.456+0000 7f702d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020036550 0x7f70200492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.460+0000 7f702d400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f702000aa90 con 0x7f7020005a90 2024-09-10T21:05:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.460+0000 7f702d400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f702000bc40 con 0x7f7020036550 2024-09-10T21:05:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.460+0000 7f702d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f702000ac10 con 0x7f702001c8c0 2024-09-10T21:05:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.462+0000 7f7025e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f702001c8c0 0x7f70200de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.462+0000 7f7027200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020036550 0x7f70200492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.462+0000 7fb5a7400640 1 -- 172.21.15.100:0/2807549566 <== mon.2 v2:172.21.15.130:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) ==== 106+0+0 (secure 0 0 0) 0x7fb5a8005680 con 0x7fb5b016b060 2024-09-10T21:05:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.463+0000 7f7027200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020036550 0x7f70200492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:55014/0 (socket says 172.21.15.100:55014) 2024-09-10T21:05:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.463+0000 7f7027200640 1 -- 172.21.15.100:0/2950621475 learned_addr learned my addr 172.21.15.100:0/2950621475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.463+0000 7f7026800640 1 --2- 172.21.15.100:0/2950621475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7020005a90 0x7f7020185a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.463+0000 7f7027200640 1 -- 172.21.15.100:0/2950621475 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f702001c8c0 msgr2=0x7f70200de240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.463+0000 7f7027200640 1 --2- 172.21.15.100:0/2950621475 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f702001c8c0 0x7f70200de240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.463+0000 7f7027200640 1 -- 172.21.15.100:0/2950621475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7020005a90 msgr2=0x7f7020185a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.463+0000 7f7027200640 1 --2- 172.21.15.100:0/2950621475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7020005a90 0x7f7020185a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.463+0000 7f7027200640 1 -- 172.21.15.100:0/2950621475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70200dbae0 con 0x7f7020036550 2024-09-10T21:05:42.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.464+0000 7f7027200640 1 --2- 172.21.15.100:0/2950621475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020036550 0x7f70200492c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f701400c3c0 tx=0x7f701400c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.468+0000 7f701ea00640 1 -- 172.21.15.100:0/2950621475 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014011790 con 0x7f7020036550 2024-09-10T21:05:42.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.468+0000 7f701ea00640 1 -- 172.21.15.100:0/2950621475 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7014017070 con 0x7f7020036550 2024-09-10T21:05:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.468+0000 7f701ea00640 1 -- 172.21.15.100:0/2950621475 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014011d40 con 0x7f7020036550 2024-09-10T21:05:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.469+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70200dbdc0 con 0x7f7020036550 2024-09-10T21:05:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.470+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70200dc380 con 0x7f7020036550 2024-09-10T21:05:42.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.470+0000 7f701ea00640 1 -- 172.21.15.100:0/2950621475 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f70140053b0 con 0x7f7020036550 2024-09-10T21:05:42.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.470+0000 7f701ea00640 1 -- 172.21.15.100:0/2950621475 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7014012780 con 0x7f7020036550 2024-09-10T21:05:42.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.473+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7020036010 con 0x7f7020036550 2024-09-10T21:05:42.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.475+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5b016b060 msgr2=0x7fb5b016cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.475+0000 7fb5b4a00640 1 --2- 172.21.15.100:0/2807549566 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5b016b060 0x7fb5b016cc20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800c780 tx=0x7fb5a800cc40 comp rx=0 tx=0).stop 2024-09-10T21:05:42.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.475+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 shutdown_connections 2024-09-10T21:05:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.475+0000 7fb5b4a00640 1 --2- 172.21.15.100:0/2807549566 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5b016b060 0x7fb5b016cc20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.475+0000 7fb5b4a00640 1 --2- 172.21.15.100:0/2807549566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5b00aef60 0x7fb5b016c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.475+0000 7fb5b4a00640 1 --2- 172.21.15.100:0/2807549566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b006fb70 0x7fb5b015f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.475+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 >> 172.21.15.100:0/2807549566 conn(0x7fb5b006cb50 msgr2=0x7fb5b00affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.476+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 shutdown_connections 2024-09-10T21:05:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.476+0000 7fb5b4a00640 1 -- 172.21.15.100:0/2807549566 wait complete. 2024-09-10T21:05:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.476+0000 7f701ea00640 1 -- 172.21.15.100:0/2950621475 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7014020020 con 0x7f7020036550 2024-09-10T21:05:42.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.479+0000 7f35a9200640 1 -- 172.21.15.100:0/1121157481 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f357c005580 con 0x7f35a40ab5d0 2024-09-10T21:05:42.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.496+0000 7f359b400640 1 -- 172.21.15.100:0/1121157481 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f3594010bc0 con 0x7f35a40ab5d0 2024-09-10T21:05:42.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 -- 172.21.15.100:0/1121157481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f35a40ab5d0 msgr2=0x7f35a40aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f35a40ab5d0 0x7f35a40aba50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35a4075730 tx=0x7f359400e6b0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 -- 172.21.15.100:0/1121157481 shutdown_connections 2024-09-10T21:05:42.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f35a40ab5d0 0x7f35a40aba50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35a4201670 0x7f35a4201af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 --2- 172.21.15.100:0/1121157481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3588004800 0x7f35a40ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 -- 172.21.15.100:0/1121157481 >> 172.21.15.100:0/1121157481 conn(0x7f35a406cb50 msgr2=0x7f35a40b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 -- 172.21.15.100:0/1121157481 shutdown_connections 2024-09-10T21:05:42.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.500+0000 7f3598c00640 1 -- 172.21.15.100:0/1121157481 wait complete. 2024-09-10T21:05:42.509 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.510 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.527 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.552+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f06d0005850 con 0x7f06f815c460 2024-09-10T21:05:42.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.560+0000 7f6ad8c00640 1 -- 172.21.15.100:0/1608816719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f6abc005850 con 0x7f6ae81fc150 2024-09-10T21:05:42.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.562+0000 7f06ef400640 1 -- 172.21.15.100:0/362954379 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v12)=0 v12) ==== 119+0+0 (secure 0 0 0) 0x7f06e4040b70 con 0x7f06f815c460 2024-09-10T21:05:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.563+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f815c460 msgr2=0x7f06f8154310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.563+0000 7f06fd000640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f815c460 0x7f06f8154310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f06e4042000 tx=0x7f06e4004b70 comp rx=0 tx=0).stop 2024-09-10T21:05:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.564+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 shutdown_connections 2024-09-10T21:05:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.564+0000 7f06fd000640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06f8161810 0x7f06f80c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.564+0000 7f06fd000640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06f815c460 0x7f06f8154310 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f06e4042000 tx=0x7f06e4004b70 comp rx=0 tx=0).stop 2024-09-10T21:05:42.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.564+0000 7f06fd000640 1 --2- 172.21.15.100:0/362954379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06f80d4560 0x7f06f814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.564+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 >> 172.21.15.100:0/362954379 conn(0x7f06f80d3a40 msgr2=0x7f06f8159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.564+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 shutdown_connections 2024-09-10T21:05:42.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.565+0000 7f6adb400640 1 -- 172.21.15.100:0/1608816719 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 120+0+0 (secure 0 0 0) 0x7f6adc04e020 con 0x7f6ae81fc150 2024-09-10T21:05:42.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.565+0000 7f06fd000640 1 -- 172.21.15.100:0/362954379 wait complete. 2024-09-10T21:05:42.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.568+0000 7f6ad8c00640 1 -- 172.21.15.100:0/1608816719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae81fc150 msgr2=0x7f6ae8157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.568+0000 7f6ad8c00640 1 --2- 172.21.15.100:0/1608816719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae81fc150 0x7f6ae8157c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009f00 tx=0x7f6adc003e60 comp rx=0 tx=0).stop 2024-09-10T21:05:42.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.569+0000 7f6ad8c00640 1 -- 172.21.15.100:0/1608816719 shutdown_connections 2024-09-10T21:05:42.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.569+0000 7f6ad8c00640 1 --2- 172.21.15.100:0/1608816719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae81fc150 0x7f6ae8157c20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.569+0000 7f6ad8c00640 1 --2- 172.21.15.100:0/1608816719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae8153600 0x7f6ae81fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.569+0000 7f6ad8c00640 1 --2- 172.21.15.100:0/1608816719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae814fd20 0x7f6ae80c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.569+0000 7f6ad8c00640 1 -- 172.21.15.100:0/1608816719 >> 172.21.15.100:0/1608816719 conn(0x7f6ae80b1380 msgr2=0x7f6ae815d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.576+0000 7f6ad8c00640 1 -- 172.21.15.100:0/1608816719 shutdown_connections 2024-09-10T21:05:42.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.577+0000 7f6ad8c00640 1 -- 172.21.15.100:0/1608816719 wait complete. 2024-09-10T21:05:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.584+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f973c03d0f0 con 0x7f973c006fa0 2024-09-10T21:05:42.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.589+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f52b015de60 con 0x7f52940053c0 2024-09-10T21:05:42.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.592+0000 7f9740c00640 1 -- 172.21.15.100:0/2988215071 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f97440bda40 con 0x7f973c006fa0 2024-09-10T21:05:42.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.593+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f973c006fa0 msgr2=0x7f973c1893b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.593+0000 7f974a000640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f973c006fa0 0x7f973c1893b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f97440661a0 tx=0x7f974406b420 comp rx=0 tx=0).stop 2024-09-10T21:05:42.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.594+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 shutdown_connections 2024-09-10T21:05:42.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.594+0000 7f974a000640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f973c006fa0 0x7f973c1893b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.594+0000 7f974a000640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f973c0e6430 0x7f973c0e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.594+0000 7f974a000640 1 --2- 172.21.15.100:0/2988215071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c053de0 0x7f973c04b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.594+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 >> 172.21.15.100:0/2988215071 conn(0x7f973c03a3d0 msgr2=0x7f973c0e1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.594+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 shutdown_connections 2024-09-10T21:05:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.594+0000 7f974a000640 1 -- 172.21.15.100:0/2988215071 wait complete. 2024-09-10T21:05:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.598+0000 7f67efe00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f015de90 0x7f67f015e310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f67f0071e00 tx=0x7f67e800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.598+0000 7f52a6000640 1 -- 172.21.15.100:0/2862811034 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f52b0146780 con 0x7f52940053c0 2024-09-10T21:05:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.598+0000 7f67e7400640 1 -- 172.21.15.100:0/3587739751 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8017030 con 0x7f67f015de90 2024-09-10T21:05:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.598+0000 7f67e7400640 1 -- 172.21.15.100:0/3587739751 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67e8004b20 con 0x7f67f015de90 2024-09-10T21:05:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.598+0000 7f67e7400640 1 -- 172.21.15.100:0/3587739751 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e800ba20 con 0x7f67f015de90 2024-09-10T21:05:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.599+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f01fc020 con 0x7f67f015de90 2024-09-10T21:05:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.600+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52940053c0 msgr2=0x7f52b0146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.600+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f01fc5e0 con 0x7f67f015de90 2024-09-10T21:05:42.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.600+0000 7f52af200640 1 --2- 172.21.15.100:0/2862811034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52940053c0 0x7f52b0146240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f52a000e6e0 tx=0x7f52a000eba0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.601+0000 7f67e7400640 1 -- 172.21.15.100:0/3587739751 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f67e8024060 con 0x7f67f015de90 2024-09-10T21:05:42.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.601+0000 7f67e7400640 1 -- 172.21.15.100:0/3587739751 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f67e801c750 con 0x7f67f015de90 2024-09-10T21:05:42.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.601+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f00cf400 con 0x7f67f015de90 2024-09-10T21:05:42.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.601+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 shutdown_connections 2024-09-10T21:05:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.601+0000 7f52af200640 1 --2- 172.21.15.100:0/2862811034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b00cd950 0x7f52b00cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.601+0000 7f52af200640 1 --2- 172.21.15.100:0/2862811034 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52b0149000 0x7f52b0149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.601+0000 7f52af200640 1 --2- 172.21.15.100:0/2862811034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52940053c0 0x7f52b0146240 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.602+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 >> 172.21.15.100:0/2862811034 conn(0x7f52b00b1480 msgr2=0x7f52b00af620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.602+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 shutdown_connections 2024-09-10T21:05:42.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.602+0000 7f52af200640 1 -- 172.21.15.100:0/2862811034 wait complete. 2024-09-10T21:05:42.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.604+0000 7f67e7400640 1 -- 172.21.15.100:0/3587739751 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f67e800bc10 con 0x7f67f015de90 2024-09-10T21:05:42.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.605+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fbacc170210 con 0x7fbacc08b270 2024-09-10T21:05:42.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.612+0000 7fbac2000640 1 -- 172.21.15.100:0/3031972643 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7fbab8003850 con 0x7fbacc08b270 2024-09-10T21:05:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.615+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbacc08b270 msgr2=0x7fbacc168d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.615+0000 7fbad0c00640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbacc08b270 0x7fbacc168d50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbab8031000 tx=0x7fbab8005d50 comp rx=0 tx=0).stop 2024-09-10T21:05:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.615+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 shutdown_connections 2024-09-10T21:05:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.615+0000 7fbad0c00640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbacc16fc80 0x7fbacc0b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.615+0000 7fbad0c00640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbacc08b650 0x7fbacc0b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.615+0000 7fbad0c00640 1 --2- 172.21.15.100:0/3031972643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbacc08b270 0x7fbacc168d50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.615+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 >> 172.21.15.100:0/3031972643 conn(0x7fbacc06d180 msgr2=0x7fbacc171590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.615+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 shutdown_connections 2024-09-10T21:05:42.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.616+0000 7fbad0c00640 1 -- 172.21.15.100:0/3031972643 wait complete. 2024-09-10T21:05:42.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.621+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f21d8005580 con 0x7f21fc0b4560 2024-09-10T21:05:42.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.623+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f702001d9d0 con 0x7f7020036550 2024-09-10T21:05:42.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.628+0000 7f21f8c00640 1 -- 172.21.15.100:0/1340191455 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v17)=0 v17) ==== 125+0+0 (secure 0 0 0) 0x7f21f0004980 con 0x7f21fc0b4560 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21fc0b4560 msgr2=0x7f21fc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21fc0b4560 0x7f21fc0ccf00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0ae7b0 tx=0x7f21f000db30 comp rx=0 tx=0).stop 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 shutdown_connections 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21fc1651d0 0x7f21fc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21fc0b4560 0x7f21fc0ccf00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 --2- 172.21.15.100:0/1340191455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21fc072990 0x7f21fc1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 >> 172.21.15.100:0/1340191455 conn(0x7f21fc06cb50 msgr2=0x7f21fc0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 shutdown_connections 2024-09-10T21:05:42.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.630+0000 7f2203a00640 1 -- 172.21.15.100:0/1340191455 wait complete. 2024-09-10T21:05:42.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.634+0000 7f701ea00640 1 -- 172.21.15.100:0/2950621475 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f70140129d0 con 0x7f7020036550 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020036550 msgr2=0x7f70200492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 --2- 172.21.15.100:0/2950621475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020036550 0x7f70200492c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f701400c3c0 tx=0x7f701400c7c0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 shutdown_connections 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 --2- 172.21.15.100:0/2950621475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020036550 0x7f70200492c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 --2- 172.21.15.100:0/2950621475 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f702001c8c0 0x7f70200de240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 --2- 172.21.15.100:0/2950621475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7020005a90 0x7f7020185a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 >> 172.21.15.100:0/2950621475 conn(0x7f7020054590 msgr2=0x7f7020052df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 shutdown_connections 2024-09-10T21:05:42.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.636+0000 7f702d400640 1 -- 172.21.15.100:0/2950621475 wait complete. 2024-09-10T21:05:42.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.684+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f67f014f070 con 0x7f67f015de90 2024-09-10T21:05:42.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.691+0000 7f67e7400640 1 -- 172.21.15.100:0/3587739751 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f67e800bdf0 con 0x7f67f015de90 2024-09-10T21:05:42.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.692+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f015de90 msgr2=0x7f67f015e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.692+0000 7f67f4e00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f015de90 0x7f67f015e310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f67f0071e00 tx=0x7f67e800dd10 comp rx=0 tx=0).stop 2024-09-10T21:05:42.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.692+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 shutdown_connections 2024-09-10T21:05:42.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.692+0000 7f67f4e00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f015de90 0x7f67f015e310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.692+0000 7f67f4e00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67f01566a0 0x7f67f014eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.692+0000 7f67f4e00640 1 --2- 172.21.15.100:0/3587739751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67d4003a70 0x7f67f01fb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.692+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 >> 172.21.15.100:0/3587739751 conn(0x7f67f006cb50 msgr2=0x7f67f015fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.693+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 shutdown_connections 2024-09-10T21:05:42.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.693+0000 7f67f4e00640 1 -- 172.21.15.100:0/3587739751 wait complete. 2024-09-10T21:05:42.710 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.710 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.711 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.711 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.711 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.711 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.711 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi100') 2024-09-10T21:05:42.711 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T21:05:42.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T21:05:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.899+0000 7f3870e00640 1 -- 172.21.15.100:0/3025293354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 msgr2=0x7f386c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.899+0000 7f3870e00640 1 --2- 172.21.15.100:0/3025293354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 0x7f386c0cf290 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f386c0ce230 tx=0x7f385802a530 comp rx=0 tx=0).stop 2024-09-10T21:05:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.899+0000 7f3870e00640 1 -- 172.21.15.100:0/3025293354 shutdown_connections 2024-09-10T21:05:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.899+0000 7f3870e00640 1 --2- 172.21.15.100:0/3025293354 >> v2:172.21.15.130:3300/0 conn(0x7f386c0b72d0 0x7f386c0b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.899+0000 7f3870e00640 1 --2- 172.21.15.100:0/3025293354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 0x7f386c0cf290 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.899+0000 7f3870e00640 1 -- 172.21.15.100:0/3025293354 >> 172.21.15.100:0/3025293354 conn(0x7f386c0d3c50 msgr2=0x7f386c0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.899+0000 7f3870e00640 1 -- 172.21.15.100:0/3025293354 shutdown_connections 2024-09-10T21:05:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.899+0000 7f3870e00640 1 -- 172.21.15.100:0/3025293354 wait complete. 2024-09-10T21:05:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.901+0000 7f3870e00640 1 Processor -- start 2024-09-10T21:05:42.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.901+0000 7f3870e00640 1 -- start start 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3870e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f386c0b72d0 0x7f386c0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3870e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 0x7f386c0c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3870e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f386c15ded0 0x7f386c0b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3870e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f386c0b7e20 con 0x7f386c0cee70 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3870e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f386c0b7ca0 con 0x7f386c15ded0 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3870e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f386c0b7fa0 con 0x7f386c0b72d0 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 0x7f386c0c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 0x7f386c0c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50472/0 (socket says 172.21.15.100:50472) 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869400640 1 -- 172.21.15.100:0/942359081 learned_addr learned my addr 172.21.15.100:0/942359081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869e00640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f386c0b72d0 0x7f386c0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f386a800640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f386c15ded0 0x7f386c0b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869400640 1 -- 172.21.15.100:0/942359081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f386c0b72d0 msgr2=0x7f386c0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869400640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f386c0b72d0 0x7f386c0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869400640 1 -- 172.21.15.100:0/942359081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f386c15ded0 msgr2=0x7f386c0b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869400640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f386c15ded0 0x7f386c0b86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.902+0000 7f3869400640 1 -- 172.21.15.100:0/942359081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c1f4fb0 con 0x7f386c0cee70 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.903+0000 7f3869400640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 0x7f386c0c99c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3858009780 tx=0x7f3858032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.903+0000 7f3862000640 1 -- 172.21.15.100:0/942359081 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858040070 con 0x7f386c0cee70 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.903+0000 7f3862000640 1 -- 172.21.15.100:0/942359081 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3858005310 con 0x7f386c0cee70 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.903+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c0cbf10 con 0x7f386c0cee70 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.903+0000 7f3862000640 1 -- 172.21.15.100:0/942359081 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38580047a0 con 0x7f386c0cee70 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.903+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c0cc4d0 con 0x7f386c0cee70 2024-09-10T21:05:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.903+0000 7f3862000640 1 -- 172.21.15.100:0/942359081 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f385804c030 con 0x7f386c0cee70 2024-09-10T21:05:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.903+0000 7f3862000640 1 -- 172.21.15.100:0/942359081 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3858003dc0 con 0x7f386c0cee70 2024-09-10T21:05:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.904+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c0b84c0 con 0x7f386c0cee70 2024-09-10T21:05:42.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.906+0000 7f3862000640 1 -- 172.21.15.100:0/942359081 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f3858004dc0 con 0x7f386c0cee70 2024-09-10T21:05:42.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.972+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f386c0d41d0 con 0x7f386c0cee70 2024-09-10T21:05:42.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.976+0000 7f3862000640 1 -- 172.21.15.100:0/942359081 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f38580035f0 con 0x7f386c0cee70 2024-09-10T21:05:42.979 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 msgr2=0x7f386c0c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 0x7f386c0c99c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3858009780 tx=0x7f3858032c10 comp rx=0 tx=0).stop 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 shutdown_connections 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f386c15ded0 0x7f386c0b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c0cee70 0x7f386c0c99c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 --2- 172.21.15.100:0/942359081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f386c0b72d0 0x7f386c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 >> 172.21.15.100:0/942359081 conn(0x7f386c0d3c50 msgr2=0x7f386c15b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 shutdown_connections 2024-09-10T21:05:42.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:42.977+0000 7f3870e00640 1 -- 172.21.15.100:0/942359081 wait complete. 2024-09-10T21:05:42.995 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T21:05:42.995 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T21:05:42.995 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:42.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T21:05:43.051 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:43.051 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T21:05:43.146 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:43.147 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T21:05:43.242 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:05:43.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T21:05:43.338 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:43.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T21:05:43.393 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:43.393 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T21:05:43.491 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:43.492 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T21:05:43.586 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:05:43.587 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T21:05:43.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 00e1ec36-cb79-42be-a075-cad84412e892 0 2024-09-10T21:05:43.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.876+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1672378669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0072450 msgr2=0x7fe8d00b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.876+0000 7fe8d4c00640 1 --2- 172.21.15.130:0/1672378669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0072450 0x7fe8d00b2c00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005fd0 tx=0x7fe8c802aa90 comp rx=0 tx=0).stop 2024-09-10T21:05:43.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.876+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1672378669 shutdown_connections 2024-09-10T21:05:43.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.876+0000 7fe8d4c00640 1 --2- 172.21.15.130:0/1672378669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0072450 0x7fe8d00b2c00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.876+0000 7fe8d4c00640 1 --2- 172.21.15.130:0/1672378669 >> v2:172.21.15.100:3300/0 conn(0x7fe8d00aefd0 0x7fe8d015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.876+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1672378669 >> 172.21.15.130:0/1672378669 conn(0x7fe8d006cb50 msgr2=0x7fe8d006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:43.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.876+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1672378669 shutdown_connections 2024-09-10T21:05:43.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.876+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1672378669 wait complete. 2024-09-10T21:05:43.882 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.878+0000 7fe8d4c00640 1 Processor -- start 2024-09-10T21:05:43.882 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.878+0000 7fe8d4c00640 1 -- start start 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0072450 0x7fe8d00ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8d00aefd0 0x7fe8d00b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0150ec0 0x7fe8d00b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8d4c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d00cfd20 con 0x7fe8d0072450 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8d4c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d00cfba0 con 0x7fe8d00aefd0 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8d4c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d00cfea0 con 0x7fe8d0150ec0 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8ce800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0150ec0 0x7fe8d00b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8ce800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0150ec0 0x7fe8d00b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:43696/0 (socket says 172.21.15.130:43696) 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8ce800640 1 -- 172.21.15.130:0/1096580714 learned_addr learned my addr 172.21.15.130:0/1096580714 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8cde00640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0072450 0x7fe8d00ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8c7e00640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8d00aefd0 0x7fe8d00b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8ce800640 1 -- 172.21.15.130:0/1096580714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8d00aefd0 msgr2=0x7fe8d00b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8ce800640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8d00aefd0 0x7fe8d00b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8ce800640 1 -- 172.21.15.130:0/1096580714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0072450 msgr2=0x7fe8d00ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8ce800640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0072450 0x7fe8d00ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.879+0000 7fe8ce800640 1 -- 172.21.15.130:0/1096580714 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d01f85d0 con 0x7fe8d0150ec0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.880+0000 7fe8ce800640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0150ec0 0x7fe8d00b1770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009d90 tx=0x7fe8c8003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.880+0000 7fe8c6000640 1 -- 172.21.15.130:0/1096580714 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8046070 con 0x7fe8d0150ec0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.880+0000 7fe8c6000640 1 -- 172.21.15.130:0/1096580714 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8c8003e50 con 0x7fe8d0150ec0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.880+0000 7fe8c6000640 1 -- 172.21.15.130:0/1096580714 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8004490 con 0x7fe8d0150ec0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.880+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d01f4570 con 0x7fe8d0150ec0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.880+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d01f4b30 con 0x7fe8d0150ec0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.880+0000 7fe8c6000640 1 -- 172.21.15.130:0/1096580714 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe8c8004630 con 0x7fe8d0150ec0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.880+0000 7fe8c6000640 1 -- 172.21.15.130:0/1096580714 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe8c804b780 con 0x7fe8d0150ec0 2024-09-10T21:05:43.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.881+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d01f4d30 con 0x7fe8d0150ec0 2024-09-10T21:05:43.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.885+0000 7fe8c6000640 1 -- 172.21.15.130:0/1096580714 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe8d01f4d30 con 0x7fe8d0150ec0 2024-09-10T21:05:43.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.957+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00e1ec36-cb79-42be-a075-cad84412e892", "id": 0} v 0) -- 0x7fe8d01f4360 con 0x7fe8d0150ec0 2024-09-10T21:05:43.966 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.962+0000 7fe8c6000640 1 -- 172.21.15.130:0/1096580714 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00e1ec36-cb79-42be-a075-cad84412e892", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe8c8050080 con 0x7fe8d0150ec0 2024-09-10T21:05:43.966 INFO:teuthology.orchestra.run.smithi130.stdout:0 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0150ec0 msgr2=0x7fe8d00b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0150ec0 0x7fe8d00b1770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009d90 tx=0x7fe8c8003ce0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 shutdown_connections 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8d0150ec0 0x7fe8d00b1770 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8d00aefd0 0x7fe8d00b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 --2- 172.21.15.130:0/1096580714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0072450 0x7fe8d00ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 >> 172.21.15.130:0/1096580714 conn(0x7fe8d006cb50 msgr2=0x7fe8d00ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 shutdown_connections 2024-09-10T21:05:43.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:43.963+0000 7fe8d4c00640 1 -- 172.21.15.130:0/1096580714 wait complete. 2024-09-10T21:05:43.983 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 01aa968c-b20a-4cd6-a555-7841ab33bc5b 1 2024-09-10T21:05:44.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.130+0000 7f0fab400640 1 -- 172.21.15.130:0/1067731002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415c750 msgr2=0x7f0fa40cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.130+0000 7f0fab400640 1 --2- 172.21.15.130:0/1067731002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415c750 0x7f0fa40cf780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40cd2b0 tx=0x7f0f9c02a820 comp rx=0 tx=0).stop 2024-09-10T21:05:44.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.130+0000 7f0fab400640 1 -- 172.21.15.130:0/1067731002 shutdown_connections 2024-09-10T21:05:44.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.130+0000 7f0fab400640 1 --2- 172.21.15.130:0/1067731002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415c750 0x7f0fa40cf780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.130+0000 7f0fab400640 1 --2- 172.21.15.130:0/1067731002 >> v2:172.21.15.100:3300/0 conn(0x7f0fa415b680 0x7f0fa415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.130+0000 7f0fab400640 1 -- 172.21.15.130:0/1067731002 >> 172.21.15.130:0/1067731002 conn(0x7f0fa406cb50 msgr2=0x7f0fa406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:44.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.130+0000 7f0fab400640 1 -- 172.21.15.130:0/1067731002 shutdown_connections 2024-09-10T21:05:44.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.131+0000 7f0fab400640 1 -- 172.21.15.130:0/1067731002 wait complete. 2024-09-10T21:05:44.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.132+0000 7f0fab400640 1 Processor -- start 2024-09-10T21:05:44.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.132+0000 7f0fab400640 1 -- start start 2024-09-10T21:05:44.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.133+0000 7f0fab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40741e0 0x7f0fa4155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.133+0000 7f0fab400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415b680 0x7f0fa4155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.133+0000 7f0fab400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fa415c750 0x7f0fa4159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.133+0000 7f0fab400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa40b2860 con 0x7f0fa40741e0 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.133+0000 7f0fab400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa40d00c0 con 0x7f0fa415b680 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.133+0000 7f0fab400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa40b29e0 con 0x7f0fa415c750 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.133+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415b680 0x7f0fa4155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fa415c750 0x7f0fa4159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40741e0 0x7f0fa4155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415b680 0x7f0fa4155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56472/0 (socket says 172.21.15.130:56472) 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fa415c750 0x7f0fa4159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:43698/0 (socket says 172.21.15.130:43698) 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40741e0 0x7f0fa4155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.130:45022/0 (socket says 172.21.15.130:45022) 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa9400640 1 -- 172.21.15.130:0/2063659808 learned_addr learned my addr 172.21.15.130:0/2063659808 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-09-10T21:05:44.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa8a00640 1 -- 172.21.15.130:0/2063659808 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fa415c750 msgr2=0x7f0fa4159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa8a00640 1 --2- 172.21.15.130:0/2063659808 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fa415c750 0x7f0fa4159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa8a00640 1 -- 172.21.15.130:0/2063659808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415b680 msgr2=0x7f0fa4155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa8a00640 1 --2- 172.21.15.130:0/2063659808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415b680 0x7f0fa4155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa8a00640 1 -- 172.21.15.130:0/2063659808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa41e5450 con 0x7f0fa40741e0 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa9400640 1 --2- 172.21.15.130:0/2063659808 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fa415c750 0x7f0fa4159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.134+0000 7f0fa8a00640 1 --2- 172.21.15.130:0/2063659808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40741e0 0x7f0fa4155c20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400e9f0 tx=0x7f0f9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.135+0000 7f0fa1600640 1 -- 172.21.15.130:0/2063659808 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400ccc0 con 0x7f0fa40741e0 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.135+0000 7f0fa1600640 1 -- 172.21.15.130:0/2063659808 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f94010430 con 0x7f0fa40741e0 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.135+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa40b0580 con 0x7f0fa40741e0 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.135+0000 7f0fa1600640 1 -- 172.21.15.130:0/2063659808 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94010860 con 0x7f0fa40741e0 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.135+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa41e56f0 con 0x7f0fa40741e0 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.135+0000 7f0fa1600640 1 -- 172.21.15.130:0/2063659808 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0f94010a00 con 0x7f0fa40741e0 2024-09-10T21:05:44.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.135+0000 7f0fa1600640 1 -- 172.21.15.130:0/2063659808 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0f940217a0 con 0x7f0fa40741e0 2024-09-10T21:05:44.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.136+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa415ae00 con 0x7f0fa40741e0 2024-09-10T21:05:44.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.138+0000 7f0fa1600640 1 -- 172.21.15.130:0/2063659808 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0f94018d30 con 0x7f0fa40741e0 2024-09-10T21:05:44.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.212+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01aa968c-b20a-4cd6-a555-7841ab33bc5b", "id": 1} v 0) -- 0x7f0fa4073820 con 0x7f0fa40741e0 2024-09-10T21:05:44.218 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.214+0000 7f0fa1600640 1 -- 172.21.15.130:0/2063659808 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01aa968c-b20a-4cd6-a555-7841ab33bc5b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0f940219a0 con 0x7f0fa40741e0 2024-09-10T21:05:44.219 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40741e0 msgr2=0x7f0fa4155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 --2- 172.21.15.130:0/2063659808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40741e0 0x7f0fa4155c20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400e9f0 tx=0x7f0f9400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 shutdown_connections 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 --2- 172.21.15.130:0/2063659808 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0fa415c750 0x7f0fa4159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 --2- 172.21.15.130:0/2063659808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fa415b680 0x7f0fa4155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 --2- 172.21.15.130:0/2063659808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40741e0 0x7f0fa4155c20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 >> 172.21.15.130:0/2063659808 conn(0x7f0fa406cb50 msgr2=0x7f0fa40ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 shutdown_connections 2024-09-10T21:05:44.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.215+0000 7f0fab400640 1 -- 172.21.15.130:0/2063659808 wait complete. 2024-09-10T21:05:44.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new dbf74690-bfe6-4315-a650-f5eab519ecc1 2 2024-09-10T21:05:44.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.384+0000 7f505d800640 1 -- 172.21.15.130:0/1098246500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f505815da80 msgr2=0x7f5058161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.384+0000 7f505d800640 1 --2- 172.21.15.130:0/1098246500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f505815da80 0x7f5058161610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5048005fd0 tx=0x7f504802a5d0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.384+0000 7f505d800640 1 -- 172.21.15.130:0/1098246500 shutdown_connections 2024-09-10T21:05:44.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.384+0000 7f505d800640 1 --2- 172.21.15.130:0/1098246500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50580cf5f0 0x7f5058161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.384+0000 7f505d800640 1 --2- 172.21.15.130:0/1098246500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f505815da80 0x7f5058161610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.384+0000 7f505d800640 1 -- 172.21.15.130:0/1098246500 >> 172.21.15.130:0/1098246500 conn(0x7f50580d3a20 msgr2=0x7f50580d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:44.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.384+0000 7f505d800640 1 -- 172.21.15.130:0/1098246500 shutdown_connections 2024-09-10T21:05:44.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.384+0000 7f505d800640 1 -- 172.21.15.130:0/1098246500 wait complete. 2024-09-10T21:05:44.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.386+0000 7f505d800640 1 Processor -- start 2024-09-10T21:05:44.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.386+0000 7f505d800640 1 -- start start 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f505d800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50580cf5f0 0x7f50580ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f505d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f505815da80 0x7f505814b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f505d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5058161b50 0x7f505814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f505d800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50580b1540 con 0x7f505815da80 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f505d800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50580b13c0 con 0x7f5058161b50 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f505d800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f50580b16c0 con 0x7f50580cf5f0 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f5057e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50580cf5f0 0x7f50580ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f505ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5058161b50 0x7f505814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f5057e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50580cf5f0 0x7f50580ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:43720/0 (socket says 172.21.15.130:43720) 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f5057e00640 1 -- 172.21.15.130:0/3563101379 learned_addr learned my addr 172.21.15.130:0/3563101379 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-09-10T21:05:44.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.387+0000 7f504fe00640 1 --2- 172.21.15.130:0/3563101379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f505815da80 0x7f505814b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5057e00640 1 -- 172.21.15.130:0/3563101379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5058161b50 msgr2=0x7f505814bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5057e00640 1 --2- 172.21.15.130:0/3563101379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5058161b50 0x7f505814bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5057e00640 1 -- 172.21.15.130:0/3563101379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f505815da80 msgr2=0x7f505814b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5057e00640 1 --2- 172.21.15.130:0/3563101379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f505815da80 0x7f505814b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5057e00640 1 -- 172.21.15.130:0/3563101379 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5058149630 con 0x7f50580cf5f0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5057e00640 1 --2- 172.21.15.130:0/3563101379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50580cf5f0 0x7f50580ca140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5048009850 tx=0x7f50480035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5054c00640 1 -- 172.21.15.130:0/3563101379 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504803f070 con 0x7f50580cf5f0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5054c00640 1 -- 172.21.15.130:0/3563101379 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5048003ce0 con 0x7f50580cf5f0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f5054c00640 1 -- 172.21.15.130:0/3563101379 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048035030 con 0x7f50580cf5f0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5058160920 con 0x7f50580cf5f0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.388+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5058149bb0 con 0x7f50580cf5f0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.389+0000 7f5054c00640 1 -- 172.21.15.130:0/3563101379 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5048004a00 con 0x7f50580cf5f0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.389+0000 7f5054c00640 1 -- 172.21.15.130:0/3563101379 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f5048005140 con 0x7f50580cf5f0 2024-09-10T21:05:44.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.389+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50580b1c50 con 0x7f50580cf5f0 2024-09-10T21:05:44.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.392+0000 7f5054c00640 1 -- 172.21.15.130:0/3563101379 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5048004d20 con 0x7f50580cf5f0 2024-09-10T21:05:44.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.464+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dbf74690-bfe6-4315-a650-f5eab519ecc1", "id": 2} v 0) -- 0x7f50580cf3b0 con 0x7f50580cf5f0 2024-09-10T21:05:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.468+0000 7f5054c00640 1 -- 172.21.15.130:0/3563101379 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dbf74690-bfe6-4315-a650-f5eab519ecc1", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f504803b730 con 0x7f50580cf5f0 2024-09-10T21:05:44.473 INFO:teuthology.orchestra.run.smithi130.stdout:2 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50580cf5f0 msgr2=0x7f50580ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 --2- 172.21.15.130:0/3563101379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50580cf5f0 0x7f50580ca140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5048009850 tx=0x7f50480035f0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 shutdown_connections 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 --2- 172.21.15.130:0/3563101379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5058161b50 0x7f505814bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 --2- 172.21.15.130:0/3563101379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f505815da80 0x7f505814b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 --2- 172.21.15.130:0/3563101379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50580cf5f0 0x7f50580ca140 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 >> 172.21.15.130:0/3563101379 conn(0x7f50580d3a20 msgr2=0x7f505815bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 shutdown_connections 2024-09-10T21:05:44.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.469+0000 7f505d800640 1 -- 172.21.15.130:0/3563101379 wait complete. 2024-09-10T21:05:44.488 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new aed4b72b-deeb-4265-b909-bce1f98aad52 3 2024-09-10T21:05:44.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.637+0000 7f8bf5a00640 1 -- 172.21.15.130:0/1686618386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf015da80 msgr2=0x7f8bf0161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.637+0000 7f8bf5a00640 1 --2- 172.21.15.130:0/1686618386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf015da80 0x7f8bf0161610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8be0005fd0 tx=0x7f8be002a5d0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.637+0000 7f8bf5a00640 1 -- 172.21.15.130:0/1686618386 shutdown_connections 2024-09-10T21:05:44.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.637+0000 7f8bf5a00640 1 --2- 172.21.15.130:0/1686618386 >> v2:172.21.15.100:3300/0 conn(0x7f8bf00cf5f0 0x7f8bf0161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.637+0000 7f8bf5a00640 1 --2- 172.21.15.130:0/1686618386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf015da80 0x7f8bf0161610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.637+0000 7f8bf5a00640 1 -- 172.21.15.130:0/1686618386 >> 172.21.15.130:0/1686618386 conn(0x7f8bf00d3a20 msgr2=0x7f8bf00d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:44.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.637+0000 7f8bf5a00640 1 -- 172.21.15.130:0/1686618386 shutdown_connections 2024-09-10T21:05:44.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.637+0000 7f8bf5a00640 1 -- 172.21.15.130:0/1686618386 wait complete. 2024-09-10T21:05:44.643 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.639+0000 7f8bf5a00640 1 Processor -- start 2024-09-10T21:05:44.643 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.639+0000 7f8bf5a00640 1 -- start start 2024-09-10T21:05:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8bf5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bf00cf5f0 0x7f8bf015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8bf5a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf015da80 0x7f8bf015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8bf5a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf0161b50 0x7f8bf015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8bf5a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf00b1540 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8bf5a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf00b13c0 con 0x7f8bf0161b50 2024-09-10T21:05:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8bf5a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf00b16c0 con 0x7f8bf015da80 2024-09-10T21:05:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8befe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bf00cf5f0 0x7f8bf015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8befe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bf00cf5f0 0x7f8bf015c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.130:45054/0 (socket says 172.21.15.130:45054) 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8be7e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf015da80 0x7f8bf015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8befe00640 1 -- 172.21.15.130:0/2996002565 learned_addr learned my addr 172.21.15.130:0/2996002565 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.640+0000 7f8bf5000640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf0161b50 0x7f8bf015ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8befe00640 1 -- 172.21.15.130:0/2996002565 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf015da80 msgr2=0x7f8bf015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8befe00640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf015da80 0x7f8bf015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8befe00640 1 -- 172.21.15.130:0/2996002565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf0161b50 msgr2=0x7f8bf015ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8befe00640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf0161b50 0x7f8bf015ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8befe00640 1 -- 172.21.15.130:0/2996002565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf0160850 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8bf5000640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf0161b50 0x7f8bf015ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:44.647 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8befe00640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bf00cf5f0 0x7f8bf015c890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009850 tx=0x7f8be00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8becc00640 1 -- 172.21.15.130:0/2996002565 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be003f070 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8becc00640 1 -- 172.21.15.130:0/2996002565 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8be0003ce0 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf0160af0 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8becc00640 1 -- 172.21.15.130:0/2996002565 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0035030 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.641+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01610b0 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.642+0000 7f8becc00640 1 -- 172.21.15.130:0/2996002565 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8be0004a00 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.642+0000 7f8becc00640 1 -- 172.21.15.130:0/2996002565 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8be003bb70 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.642+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf00b1c50 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.649 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.645+0000 7f8becc00640 1 -- 172.21.15.130:0/2996002565 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f8be003b6e0 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.717+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aed4b72b-deeb-4265-b909-bce1f98aad52", "id": 3} v 0) -- 0x7f8bf0075750 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.719+0000 7f8becc00640 1 -- 172.21.15.130:0/2996002565 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aed4b72b-deeb-4265-b909-bce1f98aad52", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8be003b960 con 0x7f8bf00cf5f0 2024-09-10T21:05:44.724 INFO:teuthology.orchestra.run.smithi130.stdout:3 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bf00cf5f0 msgr2=0x7f8bf015c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bf00cf5f0 0x7f8bf015c890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009850 tx=0x7f8be00035f0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 shutdown_connections 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf0161b50 0x7f8bf015ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf015da80 0x7f8bf015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 --2- 172.21.15.130:0/2996002565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bf00cf5f0 0x7f8bf015c890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 >> 172.21.15.130:0/2996002565 conn(0x7f8bf00d3a20 msgr2=0x7f8bf00ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 shutdown_connections 2024-09-10T21:05:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.721+0000 7f8bf5a00640 1 -- 172.21.15.130:0/2996002565 wait complete. 2024-09-10T21:05:44.741 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b 4 2024-09-10T21:05:44.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.887+0000 7fa8f4c00640 1 -- 172.21.15.130:0/4167682462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 msgr2=0x7fa8f0161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.887+0000 7fa8f4c00640 1 --2- 172.21.15.130:0/4167682462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 0x7fa8f0161610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009830 tx=0x7fa8e002a510 comp rx=0 tx=0).stop 2024-09-10T21:05:44.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.887+0000 7fa8f4c00640 1 -- 172.21.15.130:0/4167682462 shutdown_connections 2024-09-10T21:05:44.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.887+0000 7fa8f4c00640 1 --2- 172.21.15.130:0/4167682462 >> v2:172.21.15.100:3300/0 conn(0x7fa8f00cf5f0 0x7fa8f0161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.887+0000 7fa8f4c00640 1 --2- 172.21.15.130:0/4167682462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 0x7fa8f0161610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.887+0000 7fa8f4c00640 1 -- 172.21.15.130:0/4167682462 >> 172.21.15.130:0/4167682462 conn(0x7fa8f00d3a20 msgr2=0x7fa8f00d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:44.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.888+0000 7fa8f4c00640 1 -- 172.21.15.130:0/4167682462 shutdown_connections 2024-09-10T21:05:44.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.888+0000 7fa8f4c00640 1 -- 172.21.15.130:0/4167682462 wait complete. 2024-09-10T21:05:44.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.889+0000 7fa8f4c00640 1 Processor -- start 2024-09-10T21:05:44.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.889+0000 7fa8f4c00640 1 -- start start 2024-09-10T21:05:44.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8f4c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8f00cf5f0 0x7fa8f0157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8f4c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 0x7fa8f01f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8f4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8f0161b50 0x7fa8f015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8f4c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f00b1540 con 0x7fa8f0161b50 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8f4c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f00b13c0 con 0x7fa8f00cf5f0 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8f4c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f00b16c0 con 0x7fa8f015da80 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8ef400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8f00cf5f0 0x7fa8f0157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8eea00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 0x7fa8f01f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8ef400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8f00cf5f0 0x7fa8f0157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56512/0 (socket says 172.21.15.130:56512) 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.890+0000 7fa8ef400640 1 -- 172.21.15.130:0/369409058 learned_addr learned my addr 172.21.15.130:0/369409058 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8efe00640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8f0161b50 0x7fa8f015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8eea00640 1 -- 172.21.15.130:0/369409058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8f00cf5f0 msgr2=0x7fa8f0157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8eea00640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8f00cf5f0 0x7fa8f0157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8eea00640 1 -- 172.21.15.130:0/369409058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8f0161b50 msgr2=0x7fa8f015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8eea00640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8f0161b50 0x7fa8f015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8eea00640 1 -- 172.21.15.130:0/369409058 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f015a300 con 0x7fa8f015da80 2024-09-10T21:05:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8ef400640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8f00cf5f0 0x7fa8f0157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8eea00640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 0x7fa8f01f47f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c390 tx=0x7fa8dc00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.891+0000 7fa8e7400640 1 -- 172.21.15.130:0/369409058 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc011790 con 0x7fa8f015da80 2024-09-10T21:05:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.892+0000 7fa8e7400640 1 -- 172.21.15.130:0/369409058 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8dc017070 con 0x7fa8f015da80 2024-09-10T21:05:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.892+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f015a5e0 con 0x7fa8f015da80 2024-09-10T21:05:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.892+0000 7fa8e7400640 1 -- 172.21.15.130:0/369409058 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc011ce0 con 0x7fa8f015da80 2024-09-10T21:05:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.892+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f015aba0 con 0x7fa8f015da80 2024-09-10T21:05:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.892+0000 7fa8e7400640 1 -- 172.21.15.130:0/369409058 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa8dc01c460 con 0x7fa8f015da80 2024-09-10T21:05:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.892+0000 7fa8e7400640 1 -- 172.21.15.130:0/369409058 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa8dc01cc90 con 0x7fa8f015da80 2024-09-10T21:05:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.892+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f00b1c50 con 0x7fa8f015da80 2024-09-10T21:05:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.895+0000 7fa8e7400640 1 -- 172.21.15.130:0/369409058 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa8dc01c780 con 0x7fa8f015da80 2024-09-10T21:05:44.970 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.966+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b", "id": 4} v 0) -- 0x7fa8f006dca0 con 0x7fa8f015da80 2024-09-10T21:05:44.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.970+0000 7fa8e7400640 1 -- 172.21.15.130:0/369409058 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa8dc01c960 con 0x7fa8f015da80 2024-09-10T21:05:44.975 INFO:teuthology.orchestra.run.smithi130.stdout:4 2024-09-10T21:05:44.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 msgr2=0x7fa8f01f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:44.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 0x7fa8f01f47f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c390 tx=0x7fa8dc00c850 comp rx=0 tx=0).stop 2024-09-10T21:05:44.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 shutdown_connections 2024-09-10T21:05:44.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8f0161b50 0x7fa8f015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.977 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8f015da80 0x7fa8f01f47f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.977 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 --2- 172.21.15.130:0/369409058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8f00cf5f0 0x7fa8f0157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:44.977 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 >> 172.21.15.130:0/369409058 conn(0x7fa8f00d3a20 msgr2=0x7fa8f01586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:44.977 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 shutdown_connections 2024-09-10T21:05:44.977 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:44.971+0000 7fa8f4c00640 1 -- 172.21.15.130:0/369409058 wait complete. 2024-09-10T21:05:44.990 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 8c273034-22af-40cc-bbf7-ea5dca477b60 5 2024-09-10T21:05:45.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.137+0000 7f197be00640 1 -- 172.21.15.130:0/3770053522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f197c0b6830 msgr2=0x7f197c0b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.137+0000 7f197be00640 1 --2- 172.21.15.130:0/3770053522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f197c0b6830 0x7f197c0b6cc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f197c076410 tx=0x7f197402a780 comp rx=0 tx=0).stop 2024-09-10T21:05:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.138+0000 7f197be00640 1 -- 172.21.15.130:0/3770053522 shutdown_connections 2024-09-10T21:05:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.138+0000 7f197be00640 1 --2- 172.21.15.130:0/3770053522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f197c0b6830 0x7f197c0b6cc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.138+0000 7f197be00640 1 --2- 172.21.15.130:0/3770053522 >> v2:172.21.15.130:3300/0 conn(0x7f197c0cf1b0 0x7f197c0cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.138+0000 7f197be00640 1 --2- 172.21.15.130:0/3770053522 >> v2:172.21.15.100:3300/0 conn(0x7f197c160f70 0x7f197c0d4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.138+0000 7f197be00640 1 -- 172.21.15.130:0/3770053522 >> 172.21.15.130:0/3770053522 conn(0x7f197c0d3a00 msgr2=0x7f197c0d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.138+0000 7f197be00640 1 -- 172.21.15.130:0/3770053522 shutdown_connections 2024-09-10T21:05:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.138+0000 7f197be00640 1 -- 172.21.15.130:0/3770053522 wait complete. 2024-09-10T21:05:45.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.139+0000 7f197be00640 1 Processor -- start 2024-09-10T21:05:45.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.139+0000 7f197be00640 1 -- start start 2024-09-10T21:05:45.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.140+0000 7f197be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197c0b6830 0x7f197c1f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.140+0000 7f197be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f197c0cf1b0 0x7f197c1f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.140+0000 7f197be00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f197c160f70 0x7f197c0c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.140+0000 7f197be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1623d0 con 0x7f197c0cf1b0 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.140+0000 7f197be00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f197c162250 con 0x7f197c0b6830 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.140+0000 7f197be00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f197c1615d0 con 0x7f197c160f70 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197c0b6830 0x7f197c1f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197c0b6830 0x7f197c1f7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56532/0 (socket says 172.21.15.130:56532) 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 -- 172.21.15.130:0/1871899751 learned_addr learned my addr 172.21.15.130:0/1871899751 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197b400640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f197c160f70 0x7f197c0c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197a000640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f197c0cf1b0 0x7f197c1f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 -- 172.21.15.130:0/1871899751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f197c160f70 msgr2=0x7f197c0c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f197c160f70 0x7f197c0c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 -- 172.21.15.130:0/1871899751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f197c0cf1b0 msgr2=0x7f197c1f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f197c0cf1b0 0x7f197c1f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 -- 172.21.15.130:0/1871899751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c1f8a80 con 0x7f197c0b6830 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197a000640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f197c0cf1b0 0x7f197c1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.141+0000 7f197aa00640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197c0b6830 0x7f197c1f7f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f196c00e790 tx=0x7f196c00eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.142+0000 7f1972a00640 1 -- 172.21.15.130:0/1871899751 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c00cab0 con 0x7f197c0b6830 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.142+0000 7f1972a00640 1 -- 172.21.15.130:0/1871899751 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f196c00cd40 con 0x7f197c0b6830 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.142+0000 7f1972a00640 1 -- 172.21.15.130:0/1871899751 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c010690 con 0x7f197c0b6830 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.142+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c1f8d60 con 0x7f197c0b6830 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.142+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c1f4d50 con 0x7f197c0b6830 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.142+0000 7f1972a00640 1 -- 172.21.15.130:0/1871899751 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f196c010830 con 0x7f197c0b6830 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.142+0000 7f1972a00640 1 -- 172.21.15.130:0/1871899751 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f196c018da0 con 0x7f197c0b6830 2024-09-10T21:05:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.143+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197c0cf610 con 0x7f197c0b6830 2024-09-10T21:05:45.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.145+0000 7f1972a00640 1 -- 172.21.15.130:0/1871899751 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f196c010b50 con 0x7f197c0b6830 2024-09-10T21:05:45.222 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.217+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c273034-22af-40cc-bbf7-ea5dca477b60", "id": 5} v 0) -- 0x7f197c0b5040 con 0x7f197c0b6830 2024-09-10T21:05:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.221+0000 7f1972a00640 1 -- 172.21.15.130:0/1871899751 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c273034-22af-40cc-bbf7-ea5dca477b60", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f196c010d30 con 0x7f197c0b6830 2024-09-10T21:05:45.226 INFO:teuthology.orchestra.run.smithi130.stdout:5 2024-09-10T21:05:45.227 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.222+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197c0b6830 msgr2=0x7f197c1f7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.227 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.222+0000 7f197be00640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197c0b6830 0x7f197c1f7f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f196c00e790 tx=0x7f196c00eb90 comp rx=0 tx=0).stop 2024-09-10T21:05:45.227 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.223+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 shutdown_connections 2024-09-10T21:05:45.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.223+0000 7f197be00640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f197c160f70 0x7f197c0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.223+0000 7f197be00640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f197c0cf1b0 0x7f197c1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.223+0000 7f197be00640 1 --2- 172.21.15.130:0/1871899751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197c0b6830 0x7f197c1f7f50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.223+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 >> 172.21.15.130:0/1871899751 conn(0x7f197c0d3a00 msgr2=0x7f197c0d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:45.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.223+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 shutdown_connections 2024-09-10T21:05:45.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.223+0000 7f197be00640 1 -- 172.21.15.130:0/1871899751 wait complete. 2024-09-10T21:05:45.241 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 8ee93189-eb68-47cd-9c2b-7a83255ad552 6 2024-09-10T21:05:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.391+0000 7f05cd400640 1 -- 172.21.15.130:0/1724518572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 msgr2=0x7f05c80cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.391+0000 7f05cd400640 1 --2- 172.21.15.130:0/1724518572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 0x7f05c80cf0c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009830 tx=0x7f05b402a480 comp rx=0 tx=0).stop 2024-09-10T21:05:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.391+0000 7f05cd400640 1 -- 172.21.15.130:0/1724518572 shutdown_connections 2024-09-10T21:05:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.391+0000 7f05cd400640 1 --2- 172.21.15.130:0/1724518572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 0x7f05c80cf0c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.391+0000 7f05cd400640 1 --2- 172.21.15.130:0/1724518572 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05c8160ec0 0x7f05c80ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.391+0000 7f05cd400640 1 -- 172.21.15.130:0/1724518572 >> 172.21.15.130:0/1724518572 conn(0x7f05c80d3aa0 msgr2=0x7f05c80d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.391+0000 7f05cd400640 1 -- 172.21.15.130:0/1724518572 shutdown_connections 2024-09-10T21:05:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.391+0000 7f05cd400640 1 -- 172.21.15.130:0/1724518572 wait complete. 2024-09-10T21:05:45.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.393+0000 7f05cd400640 1 Processor -- start 2024-09-10T21:05:45.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.393+0000 7f05cd400640 1 -- start start 2024-09-10T21:05:45.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05cd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 0x7f05c81f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05cd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05c8160ec0 0x7f05c81f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05cd400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05c8161620 0x7f05c80cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05cd400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f05c80d48c0 con 0x7f05c8160ec0 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05cd400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f05c80d2200 con 0x7f05c80cec80 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05cd400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f05c80b1d50 con 0x7f05c8161620 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 0x7f05c81f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 0x7f05c81f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56540/0 (socket says 172.21.15.130:56540) 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7e00640 1 -- 172.21.15.130:0/1441660295 learned_addr learned my addr 172.21.15.130:0/1441660295 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-09-10T21:05:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05cca00640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05c8161620 0x7f05c80cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7400640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05c8160ec0 0x7f05c81f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7e00640 1 -- 172.21.15.130:0/1441660295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05c8161620 msgr2=0x7f05c80cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7e00640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05c8161620 0x7f05c80cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7e00640 1 -- 172.21.15.130:0/1441660295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05c8160ec0 msgr2=0x7f05c81f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7e00640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05c8160ec0 0x7f05c81f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.394+0000 7f05c7e00640 1 -- 172.21.15.130:0/1441660295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c80b9800 con 0x7f05c80cec80 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.395+0000 7f05c7e00640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 0x7f05c81f4e50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f05b800ea20 tx=0x7f05b800eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.395+0000 7f05bfe00640 1 -- 172.21.15.130:0/1441660295 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b800cd80 con 0x7f05c80cec80 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.395+0000 7f05bfe00640 1 -- 172.21.15.130:0/1441660295 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05b8010430 con 0x7f05c80cec80 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.395+0000 7f05bfe00640 1 -- 172.21.15.130:0/1441660295 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8010840 con 0x7f05c80cec80 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.395+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c80cca50 con 0x7f05c80cec80 2024-09-10T21:05:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.395+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c80cd010 con 0x7f05c80cec80 2024-09-10T21:05:45.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.395+0000 7f05bfe00640 1 -- 172.21.15.130:0/1441660295 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f05b80109e0 con 0x7f05c80cec80 2024-09-10T21:05:45.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.395+0000 7f05bfe00640 1 -- 172.21.15.130:0/1441660295 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f05b8010d00 con 0x7f05c80cec80 2024-09-10T21:05:45.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.396+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c80cf0c0 con 0x7f05c80cec80 2024-09-10T21:05:45.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.398+0000 7f05bfe00640 1 -- 172.21.15.130:0/1441660295 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f05b8018e20 con 0x7f05c80cec80 2024-09-10T21:05:45.475 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.471+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ee93189-eb68-47cd-9c2b-7a83255ad552", "id": 6} v 0) -- 0x7f05c80cfda0 con 0x7f05c80cec80 2024-09-10T21:05:45.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.475+0000 7f05bfe00640 1 -- 172.21.15.130:0/1441660295 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ee93189-eb68-47cd-9c2b-7a83255ad552", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f05b8018420 con 0x7f05c80cec80 2024-09-10T21:05:45.480 INFO:teuthology.orchestra.run.smithi130.stdout:6 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 msgr2=0x7f05c81f4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 0x7f05c81f4e50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f05b800ea20 tx=0x7f05b800eee0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 shutdown_connections 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05c8161620 0x7f05c80cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05c8160ec0 0x7f05c81f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 --2- 172.21.15.130:0/1441660295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05c80cec80 0x7f05c81f4e50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 >> 172.21.15.130:0/1441660295 conn(0x7f05c80d3aa0 msgr2=0x7f05c81600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 shutdown_connections 2024-09-10T21:05:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.476+0000 7f05cd400640 1 -- 172.21.15.130:0/1441660295 wait complete. 2024-09-10T21:05:45.495 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 5fbf7a20-02bb-4eb4-9c54-08b9ba055721 7 2024-09-10T21:05:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.643+0000 7f2f06a00640 1 -- 172.21.15.130:0/2854235927 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f000cf290 msgr2=0x7f2f001615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.643+0000 7f2f06a00640 1 --2- 172.21.15.130:0/2854235927 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f000cf290 0x7f2f001615d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009830 tx=0x7f2eec02a510 comp rx=0 tx=0).stop 2024-09-10T21:05:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.643+0000 7f2f06a00640 1 -- 172.21.15.130:0/2854235927 shutdown_connections 2024-09-10T21:05:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.643+0000 7f2f06a00640 1 --2- 172.21.15.130:0/2854235927 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f000cf290 0x7f2f001615d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.643+0000 7f2f06a00640 1 --2- 172.21.15.130:0/2854235927 >> v2:172.21.15.100:3300/0 conn(0x7f2f0015db80 0x7f2f000d4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.643+0000 7f2f06a00640 1 -- 172.21.15.130:0/2854235927 >> 172.21.15.130:0/2854235927 conn(0x7f2f000d3a00 msgr2=0x7f2f000d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.643+0000 7f2f06a00640 1 -- 172.21.15.130:0/2854235927 shutdown_connections 2024-09-10T21:05:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.643+0000 7f2f06a00640 1 -- 172.21.15.130:0/2854235927 wait complete. 2024-09-10T21:05:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.644+0000 7f2f06a00640 1 Processor -- start 2024-09-10T21:05:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.645+0000 7f2f06a00640 1 -- start start 2024-09-10T21:05:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.645+0000 7f2f06a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f000cf290 0x7f2f000ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f06a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f000cf6f0 0x7f2f001f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f06a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f0015db80 0x7f2f0015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f06a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000b6f60 con 0x7f2f000cf290 2024-09-10T21:05:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f06a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000d0dd0 con 0x7f2f000cf6f0 2024-09-10T21:05:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f06a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2f000b70e0 con 0x7f2f0015db80 2024-09-10T21:05:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f04c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f000cf6f0 0x7f2f001f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f04c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f000cf6f0 0x7f2f001f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56546/0 (socket says 172.21.15.130:56546) 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f05600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f000cf290 0x7f2f000ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f04c00640 1 -- 172.21.15.130:0/1353299512 learned_addr learned my addr 172.21.15.130:0/1353299512 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f06000640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f0015db80 0x7f2f0015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f04c00640 1 -- 172.21.15.130:0/1353299512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f0015db80 msgr2=0x7f2f0015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f04c00640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f0015db80 0x7f2f0015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f04c00640 1 -- 172.21.15.130:0/1353299512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f000cf290 msgr2=0x7f2f000ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f04c00640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f000cf290 0x7f2f000ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f04c00640 1 -- 172.21.15.130:0/1353299512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f001f48e0 con 0x7f2f000cf6f0 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.646+0000 7f2f05600640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f000cf290 0x7f2f000ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.647+0000 7f2f04c00640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f000cf6f0 0x7f2f001f43a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2eec000c00 tx=0x7f2eec032c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.647+0000 7f2efd600640 1 -- 172.21.15.130:0/1353299512 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec040070 con 0x7f2f000cf6f0 2024-09-10T21:05:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.647+0000 7f2efd600640 1 -- 172.21.15.130:0/1353299512 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2eec0038e0 con 0x7f2f000cf6f0 2024-09-10T21:05:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.647+0000 7f2efd600640 1 -- 172.21.15.130:0/1353299512 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec003d30 con 0x7f2f000cf6f0 2024-09-10T21:05:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.647+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f001f4b80 con 0x7f2f000cf6f0 2024-09-10T21:05:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.647+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f001f5140 con 0x7f2f000cf6f0 2024-09-10T21:05:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.647+0000 7f2efd600640 1 -- 172.21.15.130:0/1353299512 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2eec045670 con 0x7f2f000cf6f0 2024-09-10T21:05:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.647+0000 7f2efd600640 1 -- 172.21.15.130:0/1353299512 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f2eec03c740 con 0x7f2f000cf6f0 2024-09-10T21:05:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.648+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f00161db0 con 0x7f2f000cf6f0 2024-09-10T21:05:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.650+0000 7f2efd600640 1 -- 172.21.15.130:0/1353299512 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f2eec03ca60 con 0x7f2f000cf6f0 2024-09-10T21:05:45.728 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.722+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5fbf7a20-02bb-4eb4-9c54-08b9ba055721", "id": 7} v 0) -- 0x7f2f000b9980 con 0x7f2f000cf6f0 2024-09-10T21:05:45.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.726+0000 7f2efd600640 1 -- 172.21.15.130:0/1353299512 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5fbf7a20-02bb-4eb4-9c54-08b9ba055721", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f2eec03cc40 con 0x7f2f000cf6f0 2024-09-10T21:05:45.731 INFO:teuthology.orchestra.run.smithi130.stdout:7 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.727+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f000cf6f0 msgr2=0x7f2f001f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.727+0000 7f2f06a00640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f000cf6f0 0x7f2f001f43a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2eec000c00 tx=0x7f2eec032c10 comp rx=0 tx=0).stop 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.727+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 shutdown_connections 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.727+0000 7f2f06a00640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f0015db80 0x7f2f0015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.727+0000 7f2f06a00640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f000cf6f0 0x7f2f001f43a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.727+0000 7f2f06a00640 1 --2- 172.21.15.130:0/1353299512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f000cf290 0x7f2f000ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.727+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 >> 172.21.15.130:0/1353299512 conn(0x7f2f000d3a00 msgr2=0x7f2f0006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.728+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 shutdown_connections 2024-09-10T21:05:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:05:45.728+0000 7f2f06a00640 1 -- 172.21.15.130:0/1353299512 wait complete. 2024-09-10T21:05:45.746 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T21:05:45.747 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T21:05:45.751 INFO:tasks.ceph.osd.0:Started 2024-09-10T21:05:45.751 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T21:05:45.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T21:05:45.755 INFO:tasks.ceph.osd.1:Started 2024-09-10T21:05:45.756 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T21:05:45.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T21:05:45.760 INFO:tasks.ceph.osd.2:Started 2024-09-10T21:05:45.760 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T21:05:45.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T21:05:45.765 INFO:tasks.ceph.osd.3:Started 2024-09-10T21:05:45.765 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T21:05:45.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T21:05:45.769 INFO:tasks.ceph.osd.4:Started 2024-09-10T21:05:45.769 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T21:05:45.769 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T21:05:45.773 INFO:tasks.ceph.osd.5:Started 2024-09-10T21:05:45.773 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T21:05:45.773 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T21:05:45.778 INFO:tasks.ceph.osd.6:Started 2024-09-10T21:05:45.778 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T21:05:45.778 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T21:05:45.783 INFO:tasks.ceph.osd.7:Started 2024-09-10T21:05:45.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:05:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.980+0000 7f714e800640 1 -- 172.21.15.100:0/2279694798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71480741e0 msgr2=0x7f714815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.980+0000 7f714e800640 1 --2- 172.21.15.100:0/2279694798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71480741e0 0x7f714815f4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7130009830 tx=0x7f713002a5c0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.980+0000 7f714e800640 1 -- 172.21.15.100:0/2279694798 shutdown_connections 2024-09-10T21:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.980+0000 7f714e800640 1 --2- 172.21.15.100:0/2279694798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71480741e0 0x7f714815f4d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.980+0000 7f714e800640 1 -- 172.21.15.100:0/2279694798 >> 172.21.15.100:0/2279694798 conn(0x7f714806cb50 msgr2=0x7f714806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.980+0000 7f714e800640 1 -- 172.21.15.100:0/2279694798 shutdown_connections 2024-09-10T21:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.980+0000 7f714e800640 1 -- 172.21.15.100:0/2279694798 wait complete. 2024-09-10T21:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.982+0000 7f714e800640 1 Processor -- start 2024-09-10T21:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.982+0000 7f714e800640 1 -- start start 2024-09-10T21:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f714e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71480741e0 0x7f7148159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f714e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f714815b680 0x7f7148142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f714e800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f714815c750 0x7f71480ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f714e800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f71480b2bf0 con 0x7f71480741e0 2024-09-10T21:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f714e800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71480b2a70 con 0x7f714815b680 2024-09-10T21:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f714e800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f71480b2d70 con 0x7f714815c750 2024-09-10T21:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f7147400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71480741e0 0x7f7148159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f713fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f714815b680 0x7f7148142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f713fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f714815b680 0x7f7148142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:55088/0 (socket says 172.21.15.100:55088) 2024-09-10T21:05:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f7147400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71480741e0 0x7f7148159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50502/0 (socket says 172.21.15.100:50502) 2024-09-10T21:05:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.983+0000 7f713fe00640 1 -- 172.21.15.100:0/3802456268 learned_addr learned my addr 172.21.15.100:0/3802456268 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.984+0000 7f7147e00640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f714815c750 0x7f71480ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.984+0000 7f7147400640 1 -- 172.21.15.100:0/3802456268 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f714815c750 msgr2=0x7f71480ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.984+0000 7f7147400640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f714815c750 0x7f71480ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.984+0000 7f7147400640 1 -- 172.21.15.100:0/3802456268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f714815b680 msgr2=0x7f7148142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.984+0000 7f7147400640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f714815b680 0x7f7148142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.984+0000 7f7147400640 1 -- 172.21.15.100:0/3802456268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7148149310 con 0x7f71480741e0 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.984+0000 7f713fe00640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f714815b680 0x7f7148142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.984+0000 7f7147400640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71480741e0 0x7f7148159e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f713800c3c0 tx=0x7f713800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.985+0000 7f713f400640 1 -- 172.21.15.100:0/3802456268 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138011a30 con 0x7f71480741e0 2024-09-10T21:05:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.985+0000 7f713f400640 1 -- 172.21.15.100:0/3802456268 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7138011ce0 con 0x7f71480741e0 2024-09-10T21:05:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.985+0000 7f713f400640 1 -- 172.21.15.100:0/3802456268 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138019650 con 0x7f71480741e0 2024-09-10T21:05:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.985+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714815a390 con 0x7f71480741e0 2024-09-10T21:05:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.985+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7148145720 con 0x7f71480741e0 2024-09-10T21:05:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.985+0000 7f713f400640 1 -- 172.21.15.100:0/3802456268 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f71380197f0 con 0x7f71480741e0 2024-09-10T21:05:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.985+0000 7f713f400640 1 -- 172.21.15.100:0/3802456268 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7138018d10 con 0x7f71480741e0 2024-09-10T21:05:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.986+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714815f4d0 con 0x7f71480741e0 2024-09-10T21:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:45.988+0000 7f713f400640 1 -- 172.21.15.100:0/3802456268 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7148149310 con 0x7f71480741e0 2024-09-10T21:05:46.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.050+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7148143480 con 0x7f71480741e0 2024-09-10T21:05:46.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.051+0000 7f713f400640 1 -- 172.21.15.100:0/3802456268 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7138019b10 con 0x7f71480741e0 2024-09-10T21:05:46.056 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:05:46.056 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:05:45.725025+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:05:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71480741e0 msgr2=0x7f7148159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71480741e0 0x7f7148159e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f713800c3c0 tx=0x7f713800c880 comp rx=0 tx=0).stop 2024-09-10T21:05:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 shutdown_connections 2024-09-10T21:05:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f714815c750 0x7f71480ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:46.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f714815b680 0x7f7148142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 --2- 172.21.15.100:0/3802456268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71480741e0 0x7f7148159e50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 >> 172.21.15.100:0/3802456268 conn(0x7f714806cb50 msgr2=0x7f71480cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 shutdown_connections 2024-09-10T21:05:46.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:05:46.052+0000 7f714e800640 1 -- 172.21.15.100:0/3802456268 wait complete. 2024-09-10T21:05:46.071 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T21:05:46.071 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T21:05:46.877 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T21:05:47.020 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.015+0000 7ff5d6e00640 1 -- 172.21.15.100:0/54455410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 msgr2=0x7ff5d006cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:47.021 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.015+0000 7ff5d6e00640 1 --2- 172.21.15.100:0/54455410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 0x7ff5d006cf60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009830 tx=0x7ff5bc02a4b0 comp rx=0 tx=0).stop 2024-09-10T21:05:47.021 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.016+0000 7ff5d6e00640 1 -- 172.21.15.100:0/54455410 shutdown_connections 2024-09-10T21:05:47.021 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.016+0000 7ff5d6e00640 1 --2- 172.21.15.100:0/54455410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 0x7ff5d006cf60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:47.021 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.016+0000 7ff5d6e00640 1 -- 172.21.15.100:0/54455410 >> 172.21.15.100:0/54455410 conn(0x7ff5d00d3b10 msgr2=0x7ff5d00d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:47.021 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.016+0000 7ff5d6e00640 1 -- 172.21.15.100:0/54455410 shutdown_connections 2024-09-10T21:05:47.021 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.016+0000 7ff5d6e00640 1 -- 172.21.15.100:0/54455410 wait complete. 2024-09-10T21:05:47.022 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.017+0000 7ff5d6e00640 1 Processor -- start 2024-09-10T21:05:47.022 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.017+0000 7ff5d6e00640 1 -- start start 2024-09-10T21:05:47.023 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d6e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5d00b2b30 0x7ff5d015e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:47.023 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d6e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 0x7ff5d01f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:47.023 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d6e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d00d0520 0x7ff5d00b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:47.023 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d6e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d006dd30 con 0x7ff5d00b30a0 2024-09-10T21:05:47.023 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d6e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d006dbb0 con 0x7ff5d00d0520 2024-09-10T21:05:47.023 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d6e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d006deb0 con 0x7ff5d00b2b30 2024-09-10T21:05:47.023 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 0x7ff5d01f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:47.024 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 0x7ff5d01f3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50518/0 (socket says 172.21.15.100:50518) 2024-09-10T21:05:47.024 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.018+0000 7ff5d5000640 1 -- 172.21.15.100:0/133701072 learned_addr learned my addr 172.21.15.100:0/133701072 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:47.024 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.019+0000 7ff5d6400640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d00d0520 0x7ff5d00b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:47.024 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.019+0000 7ff5d5a00640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5d00b2b30 0x7ff5d015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:47.025 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.019+0000 7ff5d5000640 1 -- 172.21.15.100:0/133701072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5d00b2b30 msgr2=0x7ff5d015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:47.025 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.019+0000 7ff5d5000640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5d00b2b30 0x7ff5d015e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:47.025 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.019+0000 7ff5d5000640 1 -- 172.21.15.100:0/133701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d00d0520 msgr2=0x7ff5d00b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:47.025 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.019+0000 7ff5d5000640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d00d0520 0x7ff5d00b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:47.025 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.019+0000 7ff5d5000640 1 -- 172.21.15.100:0/133701072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d01f7a70 con 0x7ff5d00b30a0 2024-09-10T21:05:47.025 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.019+0000 7ff5d5000640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 0x7ff5d01f3af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc000c00 tx=0x7ff5bc032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:47.025 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.020+0000 7ff5cd600640 1 -- 172.21.15.100:0/133701072 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc040070 con 0x7ff5d00b30a0 2024-09-10T21:05:47.026 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.020+0000 7ff5cd600640 1 -- 172.21.15.100:0/133701072 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5bc032e70 con 0x7ff5d00b30a0 2024-09-10T21:05:47.026 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.020+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d01f7d50 con 0x7ff5d00b30a0 2024-09-10T21:05:47.026 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.020+0000 7ff5cd600640 1 -- 172.21.15.100:0/133701072 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0055d0 con 0x7ff5d00b30a0 2024-09-10T21:05:47.026 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.020+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d01f8310 con 0x7ff5d00b30a0 2024-09-10T21:05:47.026 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.021+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d00d0900 con 0x7ff5d00b30a0 2024-09-10T21:05:47.026 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.021+0000 7ff5cd600640 1 -- 172.21.15.100:0/133701072 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 2) ==== 50324+0+0 (secure 0 0 0) 0x7ff5bc003800 con 0x7ff5d00b30a0 2024-09-10T21:05:47.026 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.021+0000 7ff5cd600640 1 -- 172.21.15.100:0/133701072 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff5bc073160 con 0x7ff5d00b30a0 2024-09-10T21:05:47.028 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.023+0000 7ff5cd600640 1 -- 172.21.15.100:0/133701072 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff5bc003d00 con 0x7ff5d00b30a0 2024-09-10T21:05:47.060 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-09-10T21:05:47.056+0000 7faf29d30640 -1 Falling back to public interface 2024-09-10T21:05:47.064 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-09-10T21:05:47.060+0000 7f24b260b640 -1 Falling back to public interface 2024-09-10T21:05:47.091 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.087+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5d00b19d0 con 0x7ff5d00b30a0 2024-09-10T21:05:47.092 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.087+0000 7ff5cd600640 1 -- 172.21.15.100:0/133701072 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff5bc0047a0 con 0x7ff5d00b30a0 2024-09-10T21:05:47.092 INFO:teuthology.misc.health.smithi100.stdout: 2024-09-10T21:05:47.092 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":10,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:05:45.725025+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:05:47.093 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.088+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 msgr2=0x7ff5d01f3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:47.093 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.088+0000 7ff5d6e00640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 0x7ff5d01f3af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc000c00 tx=0x7ff5bc032c80 comp rx=0 tx=0).stop 2024-09-10T21:05:47.093 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.088+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 shutdown_connections 2024-09-10T21:05:47.093 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.088+0000 7ff5d6e00640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d00d0520 0x7ff5d00b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:47.093 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.088+0000 7ff5d6e00640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d00b30a0 0x7ff5d01f3af0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:47.094 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.088+0000 7ff5d6e00640 1 --2- 172.21.15.100:0/133701072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5d00b2b30 0x7ff5d015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:47.094 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.088+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 >> 172.21.15.100:0/133701072 conn(0x7ff5d00d3b10 msgr2=0x7ff5d00b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:47.094 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.089+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 shutdown_connections 2024-09-10T21:05:47.094 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:47.089+0000 7ff5d6e00640 1 -- 172.21.15.100:0/133701072 wait complete. 2024-09-10T21:05:47.105 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T21:05:47.282 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-10T21:05:47.278+0000 7fd02f287640 -1 Falling back to public interface 2024-09-10T21:05:47.300 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-09-10T21:05:47.296+0000 7fa21225e640 -1 Falling back to public interface 2024-09-10T21:05:47.328 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-10T21:05:47.324+0000 7f7e25c1a640 -1 Falling back to public interface 2024-09-10T21:05:47.329 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-10T21:05:47.325+0000 7fc46aaef640 -1 Falling back to public interface 2024-09-10T21:05:47.336 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-10T21:05:47.332+0000 7f2ad4dc5640 -1 Falling back to public interface 2024-09-10T21:05:47.337 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-09-10T21:05:47.333+0000 7fc7b520d640 -1 Falling back to public interface 2024-09-10T21:05:47.698 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-09-10T21:05:47.694+0000 7f4562000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T21:05:47.698 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-09-10T21:05:47.694+0000 7f4562000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T21:05:50.791 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-09-10T21:05:50.786+0000 7f24b260b640 -1 osd.5 0 log_to_monitors true 2024-09-10T21:05:50.957 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-10T21:05:50.952+0000 7fd02f287640 -1 osd.0 0 log_to_monitors true 2024-09-10T21:05:50.974 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-10T21:05:50.970+0000 7f7e25c1a640 -1 osd.2 0 log_to_monitors true 2024-09-10T21:05:51.100 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-09-10T21:05:51.095+0000 7faf29d30640 -1 osd.7 0 log_to_monitors true 2024-09-10T21:05:51.243 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-10T21:05:51.238+0000 7f2ad4dc5640 -1 osd.3 0 log_to_monitors true 2024-09-10T21:05:51.365 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-09-10T21:05:51.360+0000 7fc7b520d640 -1 osd.6 0 log_to_monitors true 2024-09-10T21:05:51.453 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-09-10T21:05:51.448+0000 7fa21225e640 -1 osd.4 0 log_to_monitors true 2024-09-10T21:05:51.500 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-10T21:05:51.495+0000 7fc46aaef640 -1 osd.1 0 log_to_monitors true 2024-09-10T21:05:52.766 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-09-10T21:05:52.761+0000 7f24ace00640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T21:05:52.773 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-09-10T21:05:52.769+0000 7f24a2e00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:05:53.913 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T21:05:54.085 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.080+0000 7f9424800640 1 -- 172.21.15.100:0/3763085988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94040041c0 msgr2=0x7f9404004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:54.085 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.080+0000 7f9424800640 1 --2- 172.21.15.100:0/3763085988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94040041c0 0x7f9404004800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f940c0099d0 tx=0x7f9404005830 comp rx=0 tx=0).stop 2024-09-10T21:05:54.085 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.080+0000 7f9422800640 1 -- 172.21.15.100:0/3763085988 reap_dead start 2024-09-10T21:05:54.085 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.080+0000 7f9424800640 1 -- 172.21.15.100:0/3763085988 shutdown_connections 2024-09-10T21:05:54.085 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.080+0000 7f9424800640 1 -- 172.21.15.100:0/3763085988 >> 172.21.15.100:0/3763085988 conn(0x7f941c0b1570 msgr2=0x7f941c0b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:54.085 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.080+0000 7f9424800640 1 -- 172.21.15.100:0/3763085988 shutdown_connections 2024-09-10T21:05:54.085 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.080+0000 7f9424800640 1 -- 172.21.15.100:0/3763085988 wait complete. 2024-09-10T21:05:54.086 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.082+0000 7f9424800640 1 Processor -- start 2024-09-10T21:05:54.086 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.082+0000 7f9424800640 1 -- start start 2024-09-10T21:05:54.088 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9424800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94040041c0 0x7f941c159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:54.088 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9424800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f941c157550 0x7f941c158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:54.088 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9424800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f941c15d1d0 0x7f941c147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:54.088 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9424800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0b3620 con 0x7f94040041c0 2024-09-10T21:05:54.088 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9424800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0743d0 con 0x7f941c15d1d0 2024-09-10T21:05:54.088 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9424800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f941c0b37a0 con 0x7f941c157550 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9421e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94040041c0 0x7f941c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9421e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94040041c0 0x7f941c159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50342/0 (socket says 172.21.15.100:50342) 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9421e00640 1 -- 172.21.15.100:0/688633134 learned_addr learned my addr 172.21.15.100:0/688633134 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9421400640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f941c157550 0x7f941c158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.083+0000 7f9422800640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f941c15d1d0 0x7f941c147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9421e00640 1 -- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f941c157550 msgr2=0x7f941c158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9421e00640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f941c157550 0x7f941c158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9421e00640 1 -- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f941c15d1d0 msgr2=0x7f941c147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9421e00640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f941c15d1d0 0x7f941c147ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9421e00640 1 -- 172.21.15.100:0/688633134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c157ac0 con 0x7f94040041c0 2024-09-10T21:05:54.089 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9421e00640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94040041c0 0x7f941c159800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f941000c730 tx=0x7f941000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:54.090 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9416000640 1 -- 172.21.15.100:0/688633134 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94100052d0 con 0x7f94040041c0 2024-09-10T21:05:54.090 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9416000640 1 -- 172.21.15.100:0/688633134 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9410005490 con 0x7f94040041c0 2024-09-10T21:05:54.090 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9416000640 1 -- 172.21.15.100:0/688633134 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941000a8a0 con 0x7f94040041c0 2024-09-10T21:05:54.090 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941c157da0 con 0x7f94040041c0 2024-09-10T21:05:54.090 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.084+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941c158360 con 0x7f94040041c0 2024-09-10T21:05:54.090 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.086+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941c158790 con 0x7f94040041c0 2024-09-10T21:05:54.091 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.087+0000 7f9416000640 1 -- 172.21.15.100:0/688633134 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 100545+0+0 (secure 0 0 0) 0x7f941000aa40 con 0x7f94040041c0 2024-09-10T21:05:54.092 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.087+0000 7f9416000640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9400077f10 0x7f940007a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:54.092 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.088+0000 7f9416000640 1 -- 172.21.15.100:0/688633134 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f9410098a00 con 0x7f94040041c0 2024-09-10T21:05:54.093 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.089+0000 7f9421400640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9400077f10 0x7f940007a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:54.094 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.090+0000 7f9421400640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9400077f10 0x7f940007a3d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f940c034000 tx=0x7f940c02c040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:54.097 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.093+0000 7f9416000640 1 -- 172.21.15.100:0/688633134 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9410061ae0 con 0x7f94040041c0 2024-09-10T21:05:54.344 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.337+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f941c0b3d00 con 0x7f94040041c0 2024-09-10T21:05:54.344 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.340+0000 7f9416000640 1 -- 172.21.15.100:0/688633134 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7f9410066510 con 0x7f94040041c0 2024-09-10T21:05:54.345 INFO:teuthology.misc.health.smithi100.stdout: 2024-09-10T21:05:54.345 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":14,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:05:54.119255+0000","last_up_change":"2024-09-10T21:05:52.850930+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:05:54.348 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.343+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9400077f10 msgr2=0x7f940007a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:54.348 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.343+0000 7f9424800640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9400077f10 0x7f940007a3d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f940c034000 tx=0x7f940c02c040 comp rx=0 tx=0).stop 2024-09-10T21:05:54.348 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.343+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94040041c0 msgr2=0x7f941c159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:54.348 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.343+0000 7f9424800640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94040041c0 0x7f941c159800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f941000c730 tx=0x7f941000cbf0 comp rx=0 tx=0).stop 2024-09-10T21:05:54.348 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.344+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 shutdown_connections 2024-09-10T21:05:54.349 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.344+0000 7f9424800640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9400077f10 0x7f940007a3d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:54.349 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.344+0000 7f9424800640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f941c15d1d0 0x7f941c147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:54.349 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.344+0000 7f9424800640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f941c157550 0x7f941c158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:54.349 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.344+0000 7f9424800640 1 --2- 172.21.15.100:0/688633134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94040041c0 0x7f941c159800 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:54.349 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.344+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 >> 172.21.15.100:0/688633134 conn(0x7f941c0b1570 msgr2=0x7f941c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:54.349 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.344+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 shutdown_connections 2024-09-10T21:05:54.349 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:05:54.344+0000 7f9424800640 1 -- 172.21.15.100:0/688633134 wait complete. 2024-09-10T21:05:54.381 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-10T21:05:54.647 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-09-10T21:05:54.643+0000 7fc7b0400640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T21:05:54.655 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-09-10T21:05:54.651+0000 7fc7a5a00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:05:54.679 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-09-10T21:05:54.674+0000 7fa20dc00640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T21:05:54.684 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-09-10T21:05:54.680+0000 7faf24c00640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T21:05:54.688 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-09-10T21:05:54.684+0000 7fa203200640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:05:54.691 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-09-10T21:05:54.687+0000 7faf1ac00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:05:55.163 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-10T21:05:55.156+0000 7f7e20600640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T21:05:55.176 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-10T21:05:55.172+0000 7f7e16600640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:05:55.207 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-10T21:05:55.203+0000 7f2ad0600640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T21:05:55.213 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-10T21:05:55.209+0000 7f2ac5c00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:05:55.267 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-10T21:05:55.263+0000 7fd02a200640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T21:05:55.269 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-10T21:05:55.265+0000 7fc465a00640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T21:05:55.273 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-10T21:05:55.269+0000 7fc45ba00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:05:55.275 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-10T21:05:55.271+0000 7fd020200640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:06:01.189 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:01.330 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda75600640 1 -- 172.21.15.100:0/4014941697 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda680047a0 con 0x7fda7815f1e0 2024-09-10T21:06:01.331 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda7da00640 1 -- 172.21.15.100:0/4014941697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda7815f1e0 msgr2=0x7fda7806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.331 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda7da00640 1 --2- 172.21.15.100:0/4014941697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda7815f1e0 0x7fda7806d710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda780b32a0 tx=0x7fda6802a560 comp rx=0 tx=0).stop 2024-09-10T21:06:01.331 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda7da00640 1 -- 172.21.15.100:0/4014941697 shutdown_connections 2024-09-10T21:06:01.331 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda7da00640 1 --2- 172.21.15.100:0/4014941697 >> v2:172.21.15.130:3300/0 conn(0x7fda780ce4d0 0x7fda780ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.331 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda7da00640 1 --2- 172.21.15.100:0/4014941697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda7815f1e0 0x7fda7806d710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.331 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda7da00640 1 -- 172.21.15.100:0/4014941697 >> 172.21.15.100:0/4014941697 conn(0x7fda780b32f0 msgr2=0x7fda780b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:01.331 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda7da00640 1 -- 172.21.15.100:0/4014941697 shutdown_connections 2024-09-10T21:06:01.331 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.326+0000 7fda7da00640 1 -- 172.21.15.100:0/4014941697 wait complete. 2024-09-10T21:06:01.332 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.328+0000 7fda7da00640 1 Processor -- start 2024-09-10T21:06:01.332 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.328+0000 7fda7da00640 1 -- start start 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda7da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda780b3e10 0x7fda780743c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda7da00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda780ce4d0 0x7fda780c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda7da00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda7815f1e0 0x7fda780c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda7da00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda7815f740 con 0x7fda780b3e10 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda7da00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fda7815f5c0 con 0x7fda780ce4d0 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda7da00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fda780cee40 con 0x7fda7815f1e0 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda780b3e10 0x7fda780743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda780b3e10 0x7fda780743c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50362/0 (socket says 172.21.15.100:50362) 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76a00640 1 -- 172.21.15.100:0/3196947329 learned_addr learned my addr 172.21.15.100:0/3196947329 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda77400640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda7815f1e0 0x7fda780c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:01.335 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76000640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda780ce4d0 0x7fda780c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76a00640 1 -- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda7815f1e0 msgr2=0x7fda780c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76a00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda7815f1e0 0x7fda780c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76a00640 1 -- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda780ce4d0 msgr2=0x7fda780c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76a00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda780ce4d0 0x7fda780c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.329+0000 7fda76a00640 1 -- 172.21.15.100:0/3196947329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda780ca070 con 0x7fda780b3e10 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.330+0000 7fda77400640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda7815f1e0 0x7fda780c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.330+0000 7fda76000640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda780ce4d0 0x7fda780c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.330+0000 7fda76a00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda780b3e10 0x7fda780743c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda68034040 tx=0x7fda680039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.330+0000 7fda6ea00640 1 -- 172.21.15.100:0/3196947329 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6803e030 con 0x7fda780b3e10 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.330+0000 7fda6ea00640 1 -- 172.21.15.100:0/3196947329 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda680047a0 con 0x7fda780b3e10 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.330+0000 7fda6ea00640 1 -- 172.21.15.100:0/3196947329 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68035040 con 0x7fda780b3e10 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.330+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda780c4780 con 0x7fda780b3e10 2024-09-10T21:06:01.336 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.330+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda781f49b0 con 0x7fda780b3e10 2024-09-10T21:06:01.337 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.331+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda780ce900 con 0x7fda780b3e10 2024-09-10T21:06:01.337 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.332+0000 7fda6ea00640 1 -- 172.21.15.100:0/3196947329 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fda68004bf0 con 0x7fda780b3e10 2024-09-10T21:06:01.337 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.333+0000 7fda6ea00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fda58077f70 0x7fda5807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:01.338 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.333+0000 7fda6ea00640 1 -- 172.21.15.100:0/3196947329 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fda680ba450 con 0x7fda780b3e10 2024-09-10T21:06:01.338 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.334+0000 7fda76000640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fda58077f70 0x7fda5807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:01.339 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.334+0000 7fda76000640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fda58077f70 0x7fda5807a430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda7815d640 tx=0x7fda64009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:01.342 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.338+0000 7fda6ea00640 1 -- 172.21.15.100:0/3196947329 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fda68083200 con 0x7fda780b3e10 2024-09-10T21:06:01.525 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.520+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda7806e9d0 con 0x7fda780b3e10 2024-09-10T21:06:01.526 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.521+0000 7fda6ea00640 1 -- 172.21.15.100:0/3196947329 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12920 (secure 0 0 0) 0x7fda68082b00 con 0x7fda780b3e10 2024-09-10T21:06:01.526 INFO:teuthology.misc.health.smithi100.stdout: 2024-09-10T21:06:01.526 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":19,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:05:59.725553+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:01.528 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fda58077f70 msgr2=0x7fda5807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fda58077f70 0x7fda5807a430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda7815d640 tx=0x7fda64009040 comp rx=0 tx=0).stop 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda780b3e10 msgr2=0x7fda780743c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda780b3e10 0x7fda780743c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda68034040 tx=0x7fda680039e0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 shutdown_connections 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda7815f1e0 0x7fda780c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fda58077f70 0x7fda5807a430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda780ce4d0 0x7fda780c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 --2- 172.21.15.100:0/3196947329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda780b3e10 0x7fda780743c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 >> 172.21.15.100:0/3196947329 conn(0x7fda780b32f0 msgr2=0x7fda7806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 shutdown_connections 2024-09-10T21:06:01.529 INFO:teuthology.misc.health.smithi100.stderr:2024-09-10T21:06:01.524+0000 7fda7da00640 1 -- 172.21.15.100:0/3196947329 wait complete. 2024-09-10T21:06:01.541 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T21:06:01.542 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T21:06:01.542 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T21:06:01.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T21:06:01.546 INFO:tasks.ceph.mds.a:Started 2024-09-10T21:06:01.546 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T21:06:01.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T21:06:01.550 INFO:tasks.ceph.mds.c:Started 2024-09-10T21:06:01.550 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T21:06:01.550 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T21:06:01.554 INFO:tasks.ceph.mds.b:Started 2024-09-10T21:06:01.555 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T21:06:01.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T21:06:01.558 INFO:tasks.ceph.mds.d:Started 2024-09-10T21:06:01.559 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T21:06:01.559 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:01.673 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-09-10T21:06:01.675 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-09-10T21:06:01.694 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2024-09-10T21:06:01.694 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2024-09-10T21:06:01.696 INFO:tasks.ceph.mds.b.smithi130.stderr:2024-09-10T21:06:01.691+0000 7eff6c000640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-10T21:06:01.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.719+0000 7f3193e00640 1 -- 172.21.15.100:0/410592478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406d060 msgr2=0x7f319406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.719+0000 7f3193e00640 1 --2- 172.21.15.100:0/410592478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406d060 0x7f319406d510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f318c005fd0 tx=0x7f318c02aa10 comp rx=0 tx=0).stop 2024-09-10T21:06:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.720+0000 7f3193e00640 1 -- 172.21.15.100:0/410592478 shutdown_connections 2024-09-10T21:06:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.720+0000 7f3193e00640 1 --2- 172.21.15.100:0/410592478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406d060 0x7f319406d510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.720+0000 7f3193e00640 1 --2- 172.21.15.100:0/410592478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3194161140 0x7f31940b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.720+0000 7f3193e00640 1 -- 172.21.15.100:0/410592478 >> 172.21.15.100:0/410592478 conn(0x7f31940d3ab0 msgr2=0x7f31940d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.720+0000 7f3193e00640 1 -- 172.21.15.100:0/410592478 shutdown_connections 2024-09-10T21:06:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.720+0000 7f3193e00640 1 -- 172.21.15.100:0/410592478 wait complete. 2024-09-10T21:06:01.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.721+0000 7f3193e00640 1 Processor -- start 2024-09-10T21:06:01.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.721+0000 7f3193e00640 1 -- start start 2024-09-10T21:06:01.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.722+0000 7f3193e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f319406d060 0x7f31940a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:01.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.722+0000 7f3193e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406e0a0 0x7f31941f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:01.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.722+0000 7f3193e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3194161140 0x7f31941f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:01.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.722+0000 7f3193e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3194161520 con 0x7f319406d060 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.722+0000 7f3193e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31940b28a0 con 0x7f319406e0a0 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.722+0000 7f3193e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f31941616a0 con 0x7f3194161140 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f319406d060 0x7f31940a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f319406d060 0x7f31940a10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50424/0 (socket says 172.21.15.100:50424) 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 -- 172.21.15.100:0/1733401351 learned_addr learned my addr 172.21.15.100:0/1733401351 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192000640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406e0a0 0x7f31941f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3193400640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3194161140 0x7f31941f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 -- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3194161140 msgr2=0x7f31941f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3194161140 0x7f31941f7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 -- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406e0a0 msgr2=0x7f31941f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406e0a0 0x7f31941f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 -- 172.21.15.100:0/1733401351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31940b5250 con 0x7f319406d060 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192000640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406e0a0 0x7f31941f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.723+0000 7f3192a00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f319406d060 0x7f31940a10d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f318400e790 tx=0x7f318400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:01.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.724+0000 7f318aa00640 1 -- 172.21.15.100:0/1733401351 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318400eea0 con 0x7f319406d060 2024-09-10T21:06:01.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.724+0000 7f318aa00640 1 -- 172.21.15.100:0/1733401351 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f318400cdb0 con 0x7f319406d060 2024-09-10T21:06:01.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.724+0000 7f318aa00640 1 -- 172.21.15.100:0/1733401351 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184010690 con 0x7f319406d060 2024-09-10T21:06:01.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.724+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941f5650 con 0x7f319406d060 2024-09-10T21:06:01.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.724+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941f5c10 con 0x7f319406d060 2024-09-10T21:06:01.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.725+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319406c500 con 0x7f319406d060 2024-09-10T21:06:01.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.726+0000 7f318aa00640 1 -- 172.21.15.100:0/1733401351 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3184010830 con 0x7f319406d060 2024-09-10T21:06:01.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.727+0000 7f318aa00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3174077f70 0x7f317407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:01.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.728+0000 7f318aa00640 1 -- 172.21.15.100:0/1733401351 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f318409a3a0 con 0x7f319406d060 2024-09-10T21:06:01.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.728+0000 7f3192000640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3174077f70 0x7f317407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:01.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.728+0000 7f3192000640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3174077f70 0x7f317407a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31940d0370 tx=0x7f3180009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.732+0000 7f318aa00640 1 -- 172.21.15.100:0/1733401351 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3184062b90 con 0x7f319406d060 2024-09-10T21:06:01.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:06:01.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:06:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.952+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f319406e8e0 con 0x7f319406d060 2024-09-10T21:06:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.953+0000 7f318aa00640 1 -- 172.21.15.100:0/1733401351 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f31840675c0 con 0x7f319406d060 2024-09-10T21:06:01.957 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:01.958 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"btime":"2024-09-10T21:06:01:680160+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T21:06:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-09-10T21:06:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3174077f70 msgr2=0x7f317407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3174077f70 0x7f317407a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31940d0370 tx=0x7f3180009040 comp rx=0 tx=0).stop 2024-09-10T21:06:01.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f319406d060 msgr2=0x7f31940a10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f319406d060 0x7f31940a10d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f318400e790 tx=0x7f318400ec50 comp rx=0 tx=0).stop 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 shutdown_connections 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3194161140 0x7f31941f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3174077f70 0x7f317407a430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f319406e0a0 0x7f31941f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 --2- 172.21.15.100:0/1733401351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f319406d060 0x7f31940a10d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.955+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 >> 172.21.15.100:0/1733401351 conn(0x7f31940d3ab0 msgr2=0x7f31940b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.956+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 shutdown_connections 2024-09-10T21:06:01.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:01.956+0000 7f3193e00640 1 -- 172.21.15.100:0/1733401351 wait complete. 2024-09-10T21:06:03.977 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:04.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.138+0000 7fd9b1200640 1 -- 172.21.15.100:0/71378721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac0aefd0 msgr2=0x7fd9ac15b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.138+0000 7fd9b1200640 1 --2- 172.21.15.100:0/71378721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac0aefd0 0x7fd9ac15b020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd998009900 tx=0x7fd99802a610 comp rx=0 tx=0).stop 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.138+0000 7fd9b1200640 1 -- 172.21.15.100:0/71378721 shutdown_connections 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.138+0000 7fd9b1200640 1 --2- 172.21.15.100:0/71378721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9ac072450 0x7fd9ac0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.138+0000 7fd9b1200640 1 --2- 172.21.15.100:0/71378721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac0aefd0 0x7fd9ac15b020 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.138+0000 7fd9b1200640 1 -- 172.21.15.100:0/71378721 >> 172.21.15.100:0/71378721 conn(0x7fd9ac06cb50 msgr2=0x7fd9ac06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.138+0000 7fd9b1200640 1 -- 172.21.15.100:0/71378721 shutdown_connections 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.138+0000 7fd9b1200640 1 -- 172.21.15.100:0/71378721 wait complete. 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.140+0000 7fd9b1200640 1 Processor -- start 2024-09-10T21:06:04.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.140+0000 7fd9b1200640 1 -- start start 2024-09-10T21:06:04.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9b1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac072450 0x7fd9ac14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9b1200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9ac0aefd0 0x7fd9ac152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9b1200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9ac150ec0 0x7fd9ac1e8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9b1200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac0cfcc0 con 0x7fd9ac072450 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9b1200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac0cfb40 con 0x7fd9ac150ec0 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9b1200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ac0cfe40 con 0x7fd9ac0aefd0 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9a9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac072450 0x7fd9ac14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9a9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac072450 0x7fd9ac14d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52854/0 (socket says 172.21.15.100:52854) 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9a9e00640 1 -- 172.21.15.100:0/1409189937 learned_addr learned my addr 172.21.15.100:0/1409189937 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9a9e00640 1 -- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9ac0aefd0 msgr2=0x7fd9ac152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9a9e00640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9ac0aefd0 0x7fd9ac152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9a9e00640 1 -- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9ac150ec0 msgr2=0x7fd9ac1e8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9a9e00640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9ac150ec0 0x7fd9ac1e8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.141+0000 7fd9a9e00640 1 -- 172.21.15.100:0/1409189937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac0a95c0 con 0x7fd9ac072450 2024-09-10T21:06:04.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.142+0000 7fd9a9e00640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac072450 0x7fd9ac14d950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c3a0 tx=0x7fd99c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:04.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.142+0000 7fd9a2000640 1 -- 172.21.15.100:0/1409189937 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c017070 con 0x7fd9ac072450 2024-09-10T21:06:04.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.142+0000 7fd9a2000640 1 -- 172.21.15.100:0/1409189937 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd99c0053c0 con 0x7fd9ac072450 2024-09-10T21:06:04.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.142+0000 7fd9a2000640 1 -- 172.21.15.100:0/1409189937 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c003850 con 0x7fd9ac072450 2024-09-10T21:06:04.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.142+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ac0a98a0 con 0x7fd9ac072450 2024-09-10T21:06:04.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.142+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ac0a9e60 con 0x7fd9ac072450 2024-09-10T21:06:04.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.143+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9ac0b1d10 con 0x7fd9ac072450 2024-09-10T21:06:04.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.144+0000 7fd9a2000640 1 -- 172.21.15.100:0/1409189937 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd99c0039f0 con 0x7fd9ac072450 2024-09-10T21:06:04.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.145+0000 7fd9a2000640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd98c077f70 0x7fd98c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.145+0000 7fd9a2000640 1 -- 172.21.15.100:0/1409189937 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fd99c0990f0 con 0x7fd9ac072450 2024-09-10T21:06:04.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.145+0000 7fd9a9400640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd98c077f70 0x7fd98c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.146+0000 7fd9a9400640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd98c077f70 0x7fd98c07a430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd998033000 tx=0x7fd9980046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:04.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.150+0000 7fd9a2000640 1 -- 172.21.15.100:0/1409189937 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd99c061ea0 con 0x7fd9ac072450 2024-09-10T21:06:04.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.368+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9ac1592d0 con 0x7fd9ac072450 2024-09-10T21:06:04.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.368+0000 7fd9a2000640 1 -- 172.21.15.100:0/1409189937 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7fd99c0617a0 con 0x7fd9ac072450 2024-09-10T21:06:04.373 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:04.373 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"btime":"2024-09-10T21:06:02:681590+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T21:06:04.373 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-09-10T21:06:04.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd98c077f70 msgr2=0x7fd98c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd98c077f70 0x7fd98c07a430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd998033000 tx=0x7fd9980046c0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac072450 msgr2=0x7fd9ac14d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac072450 0x7fd9ac14d950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c3a0 tx=0x7fd99c00c860 comp rx=0 tx=0).stop 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 shutdown_connections 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd98c077f70 0x7fd98c07a430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9ac150ec0 0x7fd9ac1e8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9ac0aefd0 0x7fd9ac152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 --2- 172.21.15.100:0/1409189937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9ac072450 0x7fd9ac14d950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 >> 172.21.15.100:0/1409189937 conn(0x7fd9ac06cb50 msgr2=0x7fd9ac1597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 shutdown_connections 2024-09-10T21:06:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.371+0000 7fd9b1200640 1 -- 172.21.15.100:0/1409189937 wait complete. 2024-09-10T21:06:04.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T21:06:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.543+0000 7f17e3800640 1 -- 172.21.15.100:0/2869347350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc0741e0 msgr2=0x7f17dc15f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.543+0000 7f17e3800640 1 --2- 172.21.15.100:0/2869347350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc0741e0 0x7f17dc15f4d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17c8005fd0 tx=0x7f17c802a5d0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.543+0000 7f17e3800640 1 -- 172.21.15.100:0/2869347350 shutdown_connections 2024-09-10T21:06:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.543+0000 7f17e3800640 1 --2- 172.21.15.100:0/2869347350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc0741e0 0x7f17dc15f4d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.543+0000 7f17e3800640 1 --2- 172.21.15.100:0/2869347350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17dc15b680 0x7f17dc15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.543+0000 7f17e3800640 1 -- 172.21.15.100:0/2869347350 >> 172.21.15.100:0/2869347350 conn(0x7f17dc06cb50 msgr2=0x7f17dc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.543+0000 7f17e3800640 1 -- 172.21.15.100:0/2869347350 shutdown_connections 2024-09-10T21:06:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.543+0000 7f17e3800640 1 -- 172.21.15.100:0/2869347350 wait complete. 2024-09-10T21:06:04.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.545+0000 7f17e3800640 1 Processor -- start 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.545+0000 7f17e3800640 1 -- start start 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17e3800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17dc0741e0 0x7f17dc0ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17e3800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc15b680 0x7f17dc0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17e3800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17dc15c750 0x7f17dc1f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17e3800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc0b29e0 con 0x7f17dc15b680 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17e3800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc0b2860 con 0x7f17dc15c750 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17e3800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc0b2b60 con 0x7f17dc0741e0 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc15b680 0x7f17dc0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc15b680 0x7f17dc0b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52868/0 (socket says 172.21.15.100:52868) 2024-09-10T21:06:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 -- 172.21.15.100:0/805315245 learned_addr learned my addr 172.21.15.100:0/805315245 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17e0e00640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17dc0741e0 0x7f17dc0ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17e1800640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17dc15c750 0x7f17dc1f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 -- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17dc0741e0 msgr2=0x7f17dc0ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17dc0741e0 0x7f17dc0ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 -- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17dc15c750 msgr2=0x7f17dc1f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17dc15c750 0x7f17dc1f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 -- 172.21.15.100:0/805315245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc0b0250 con 0x7f17dc15b680 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.546+0000 7f17dbe00640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc15b680 0x7f17dc0b13d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006010 tx=0x7f17c80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.547+0000 7f17d8c00640 1 -- 172.21.15.100:0/805315245 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c803f070 con 0x7f17dc15b680 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.547+0000 7f17d8c00640 1 -- 172.21.15.100:0/805315245 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17c8005600 con 0x7f17dc15b680 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.547+0000 7f17d8c00640 1 -- 172.21.15.100:0/805315245 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c8035030 con 0x7f17dc15b680 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.547+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17dc0b0530 con 0x7f17dc15b680 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.547+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17dc0b0af0 con 0x7f17dc15b680 2024-09-10T21:06:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.548+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17dc0b3010 con 0x7f17dc15b680 2024-09-10T21:06:04.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.549+0000 7f17d8c00640 1 -- 172.21.15.100:0/805315245 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f17c80049e0 con 0x7f17dc15b680 2024-09-10T21:06:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.551+0000 7f17d8c00640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f17bc077f70 0x7f17bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.551+0000 7f17d8c00640 1 -- 172.21.15.100:0/805315245 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f17c80ba930 con 0x7f17dc15b680 2024-09-10T21:06:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.551+0000 7f17e0e00640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f17bc077f70 0x7f17bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.551+0000 7f17e0e00640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f17bc077f70 0x7f17bc07a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17cc005fd0 tx=0x7f17cc005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:04.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.555+0000 7f17d8c00640 1 -- 172.21.15.100:0/805315245 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f17c8083770 con 0x7f17dc15b680 2024-09-10T21:06:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.740+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f17dc0b0f30 con 0x7f17dc15b680 2024-09-10T21:06:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.741+0000 7f17d8c00640 1 -- 172.21.15.100:0/805315245 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f17c8083070 con 0x7f17dc15b680 2024-09-10T21:06:04.745 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:04.745 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-09-10T21:06:04.745 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:06:04.745 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-09-10T21:06:04.745 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-09-10T21:06:04.745 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:06:04.745 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f17bc077f70 msgr2=0x7f17bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f17bc077f70 0x7f17bc07a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17cc005fd0 tx=0x7f17cc005850 comp rx=0 tx=0).stop 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc15b680 msgr2=0x7f17dc0b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc15b680 0x7f17dc0b13d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006010 tx=0x7f17c80038a0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 shutdown_connections 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f17bc077f70 0x7f17bc07a430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17dc15c750 0x7f17dc1f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc15b680 0x7f17dc0b13d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 --2- 172.21.15.100:0/805315245 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17dc0741e0 0x7f17dc0ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 >> 172.21.15.100:0/805315245 conn(0x7f17dc06cb50 msgr2=0x7f17dc06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:04.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 shutdown_connections 2024-09-10T21:06:04.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.743+0000 7f17e3800640 1 -- 172.21.15.100:0/805315245 wait complete. 2024-09-10T21:06:04.762 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T21:06:04.762 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T21:06:04.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.919+0000 7f7f5d000640 1 -- 172.21.15.100:0/1280374126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f5806e0a0 msgr2=0x7f7f580d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.919+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1280374126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f5806e0a0 0x7f7f580d2090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009830 tx=0x7f7f4402a480 comp rx=0 tx=0).stop 2024-09-10T21:06:04.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.919+0000 7f7f5d000640 1 -- 172.21.15.100:0/1280374126 shutdown_connections 2024-09-10T21:06:04.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.919+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1280374126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f5806e0a0 0x7f7f580d2090 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.919+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1280374126 >> v2:172.21.15.130:3300/0 conn(0x7f7f58161140 0x7f7f580b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.919+0000 7f7f5d000640 1 -- 172.21.15.100:0/1280374126 >> 172.21.15.100:0/1280374126 conn(0x7f7f580d3ab0 msgr2=0x7f7f580d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:04.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.919+0000 7f7f5d000640 1 -- 172.21.15.100:0/1280374126 shutdown_connections 2024-09-10T21:06:04.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.919+0000 7f7f5d000640 1 -- 172.21.15.100:0/1280374126 wait complete. 2024-09-10T21:06:04.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.921+0000 7f7f5d000640 1 Processor -- start 2024-09-10T21:06:04.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.921+0000 7f7f5d000640 1 -- start start 2024-09-10T21:06:04.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f5d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5806e0a0 0x7f7f58156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f5d000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f58161140 0x7f7f58156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f5d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f580b5530 0x7f7f580b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f5d000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5806e770 con 0x7f7f580b5530 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f5d000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58161730 con 0x7f7f5806e0a0 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f5d000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5806e8f0 con 0x7f7f58161140 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f580b5530 0x7f7f580b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f56a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f58161140 0x7f7f58156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f57400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5806e0a0 0x7f7f58156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f56a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f58161140 0x7f7f58156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:35242/0 (socket says 172.21.15.100:35242) 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f580b5530 0x7f7f580b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52874/0 (socket says 172.21.15.100:52874) 2024-09-10T21:06:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f56a00640 1 -- 172.21.15.100:0/1063441260 learned_addr learned my addr 172.21.15.100:0/1063441260 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:04.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f57e00640 1 -- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f58161140 msgr2=0x7f7f58156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f57e00640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f58161140 0x7f7f58156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f57e00640 1 -- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5806e0a0 msgr2=0x7f7f58156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f57e00640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5806e0a0 0x7f7f58156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.922+0000 7f7f57e00640 1 -- 172.21.15.100:0/1063441260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f580c7680 con 0x7f7f580b5530 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.923+0000 7f7f57e00640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f580b5530 0x7f7f580b59a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000c650 tx=0x7f7f5000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.923+0000 7f7f4f400640 1 -- 172.21.15.100:0/1063441260 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50003b70 con 0x7f7f580b5530 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.923+0000 7f7f4f400640 1 -- 172.21.15.100:0/1063441260 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f50003d10 con 0x7f7f580b5530 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.923+0000 7f7f4f400640 1 -- 172.21.15.100:0/1063441260 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50005330 con 0x7f7f580b5530 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.923+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f580c7960 con 0x7f7f580b5530 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.923+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f580c7f20 con 0x7f7f580b5530 2024-09-10T21:06:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.924+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f580008d0 con 0x7f7f580b5530 2024-09-10T21:06:04.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.925+0000 7f7f4f400640 1 -- 172.21.15.100:0/1063441260 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7f500054d0 con 0x7f7f580b5530 2024-09-10T21:06:04.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.926+0000 7f7f4f400640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f38077f70 0x7f7f3807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:04.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.926+0000 7f7f4f400640 1 -- 172.21.15.100:0/1063441260 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f7f50099670 con 0x7f7f580b5530 2024-09-10T21:06:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.927+0000 7f7f57400640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f38077f70 0x7f7f3807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.927+0000 7f7f57400640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f38077f70 0x7f7f3807a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009530 tx=0x7f7f48009260 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:04.930+0000 7f7f4f400640 1 -- 172.21.15.100:0/1063441260 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7f500057f0 con 0x7f7f580b5530 2024-09-10T21:06:05.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.112+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7f580d1f80 con 0x7f7f580b5530 2024-09-10T21:06:05.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.691+0000 7f7f4f400640 1 -- 172.21.15.100:0/1063441260 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f7f50061dd0 con 0x7f7f580b5530 2024-09-10T21:06:05.695 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-09-10T21:06:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f38077f70 msgr2=0x7f7f3807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f38077f70 0x7f7f3807a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009530 tx=0x7f7f48009260 comp rx=0 tx=0).stop 2024-09-10T21:06:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f580b5530 msgr2=0x7f7f580b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f580b5530 0x7f7f580b59a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000c650 tx=0x7f7f5000cb10 comp rx=0 tx=0).stop 2024-09-10T21:06:05.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 shutdown_connections 2024-09-10T21:06:05.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f580b5530 0x7f7f580b59a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:05.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f58161140 0x7f7f58156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:05.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f38077f70 0x7f7f3807a430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:05.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 --2- 172.21.15.100:0/1063441260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5806e0a0 0x7f7f58156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:05.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 >> 172.21.15.100:0/1063441260 conn(0x7f7f580d3ab0 msgr2=0x7f7f580b72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:05.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.695+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 shutdown_connections 2024-09-10T21:06:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.696+0000 7f7f5d000640 1 -- 172.21.15.100:0/1063441260 wait complete. 2024-09-10T21:06:05.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-10T21:06:05.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.883+0000 7f491e600640 1 -- 172.21.15.100:0/531175382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48fc004040 msgr2=0x7f48fc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:05.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.883+0000 7f491e600640 1 --2- 172.21.15.100:0/531175382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48fc004040 0x7f48fc004800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4904009b50 tx=0x7f48fc005830 comp rx=0 tx=0).stop 2024-09-10T21:06:05.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.883+0000 7f491dc00640 1 -- 172.21.15.100:0/531175382 reap_dead start 2024-09-10T21:06:05.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.883+0000 7f491e600640 1 -- 172.21.15.100:0/531175382 shutdown_connections 2024-09-10T21:06:05.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.883+0000 7f491e600640 1 -- 172.21.15.100:0/531175382 >> 172.21.15.100:0/531175382 conn(0x7f49180b12e0 msgr2=0x7f49180b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:05.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.883+0000 7f491e600640 1 -- 172.21.15.100:0/531175382 shutdown_connections 2024-09-10T21:06:05.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.883+0000 7f491e600640 1 -- 172.21.15.100:0/531175382 wait complete. 2024-09-10T21:06:05.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.885+0000 7f491e600640 1 Processor -- start 2024-09-10T21:06:05.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.885+0000 7f491e600640 1 -- start start 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f491e600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48fc004040 0x7f491815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f491e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491814c140 0x7f491814b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f491e600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4918153c90 0x7f4918154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f491e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f491806f0f0 con 0x7f491814c140 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f491e600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f491806ef70 con 0x7f48fc004040 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f491e600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f491806f270 con 0x7f4918153c90 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f4917e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491814c140 0x7f491814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f4917e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491814c140 0x7f491814b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52890/0 (socket says 172.21.15.100:52890) 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.886+0000 7f4917e00640 1 -- 172.21.15.100:0/3361609735 learned_addr learned my addr 172.21.15.100:0/3361609735 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4917e00640 1 -- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4918153c90 msgr2=0x7f4918154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:05.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4917e00640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4918153c90 0x7f4918154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4917e00640 1 -- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48fc004040 msgr2=0x7f491815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4917e00640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48fc004040 0x7f491815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4917e00640 1 -- 172.21.15.100:0/3361609735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49181f6410 con 0x7f491814c140 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4917e00640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491814c140 0x7f491814b090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4904009a70 tx=0x7f4904033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4914c00640 1 -- 172.21.15.100:0/3361609735 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904038040 con 0x7f491814c140 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4914c00640 1 -- 172.21.15.100:0/3361609735 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4904041070 con 0x7f491814c140 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49181f7190 con 0x7f491814c140 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f4914c00640 1 -- 172.21.15.100:0/3361609735 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904033d90 con 0x7f491814c140 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.887+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49181f6990 con 0x7f491814c140 2024-09-10T21:06:05.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.889+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49180cd5b0 con 0x7f491814c140 2024-09-10T21:06:05.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.890+0000 7f4914c00640 1 -- 172.21.15.100:0/3361609735 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f490403b070 con 0x7f491814c140 2024-09-10T21:06:05.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.891+0000 7f4914c00640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f48f8077fa0 0x7f48f807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:05.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.891+0000 7f4914c00640 1 -- 172.21.15.100:0/3361609735 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f49040ba1f0 con 0x7f491814c140 2024-09-10T21:06:05.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.891+0000 7f491d200640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f48f8077fa0 0x7f48f807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:05.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.892+0000 7f491d200640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f48f8077fa0 0x7f48f807a460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4908001c80 tx=0x7f4908001530 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:05.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:05.895+0000 7f4914c00640 1 -- 172.21.15.100:0/3361609735 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4904082f80 con 0x7f491814c140 2024-09-10T21:06:06.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.080+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4918070430 con 0x7f491814c140 2024-09-10T21:06:06.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.702+0000 7f4914c00640 1 -- 172.21.15.100:0/3361609735 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f4904082880 con 0x7f491814c140 2024-09-10T21:06:06.705 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-09-10T21:06:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f48f8077fa0 msgr2=0x7f48f807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f48f8077fa0 0x7f48f807a460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4908001c80 tx=0x7f4908001530 comp rx=0 tx=0).stop 2024-09-10T21:06:06.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491814c140 msgr2=0x7f491814b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491814c140 0x7f491814b090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4904009a70 tx=0x7f4904033670 comp rx=0 tx=0).stop 2024-09-10T21:06:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 shutdown_connections 2024-09-10T21:06:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4918153c90 0x7f4918154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f491814c140 0x7f491814b090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f48f8077fa0 0x7f48f807a460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.705+0000 7f491e600640 1 --2- 172.21.15.100:0/3361609735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48fc004040 0x7f491815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.706+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 >> 172.21.15.100:0/3361609735 conn(0x7f49180b12e0 msgr2=0x7f49180b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.706+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 shutdown_connections 2024-09-10T21:06:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.706+0000 7f491e600640 1 -- 172.21.15.100:0/3361609735 wait complete. 2024-09-10T21:06:06.743 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T21:06:06.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.899+0000 7fccaba00640 1 -- 172.21.15.100:0/461351122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 msgr2=0x7fcca4161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:06.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.899+0000 7fccaba00640 1 --2- 172.21.15.100:0/461351122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 0x7fcca4161640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc90005fd0 tx=0x7fcc9002a670 comp rx=0 tx=0).stop 2024-09-10T21:06:06.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.899+0000 7fccaba00640 1 -- 172.21.15.100:0/461351122 shutdown_connections 2024-09-10T21:06:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.899+0000 7fccaba00640 1 --2- 172.21.15.100:0/461351122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 0x7fcca4161640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.899+0000 7fccaba00640 1 --2- 172.21.15.100:0/461351122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcca415b4d0 0x7fcca415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.899+0000 7fccaba00640 1 -- 172.21.15.100:0/461351122 >> 172.21.15.100:0/461351122 conn(0x7fcca406cb50 msgr2=0x7fcca406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.899+0000 7fccaba00640 1 -- 172.21.15.100:0/461351122 shutdown_connections 2024-09-10T21:06:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.899+0000 7fccaba00640 1 -- 172.21.15.100:0/461351122 wait complete. 2024-09-10T21:06:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.901+0000 7fccaba00640 1 Processor -- start 2024-09-10T21:06:06.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.901+0000 7fccaba00640 1 -- start start 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fccaba00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcca406eb60 0x7fcca40b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fccaba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 0x7fcca40c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fccaba00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcca415b4d0 0x7fcca41f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fccaba00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcca406f3a0 con 0x7fcca40cf810 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fccaba00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcca406f220 con 0x7fcca415b4d0 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fccaba00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcca40b3120 con 0x7fcca406eb60 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fcca3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 0x7fcca40c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fcca3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 0x7fcca40c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52910/0 (socket says 172.21.15.100:52910) 2024-09-10T21:06:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fcca3e00640 1 -- 172.21.15.100:0/3543816505 learned_addr learned my addr 172.21.15.100:0/3543816505 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fcca9000640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcca406eb60 0x7fcca40b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.902+0000 7fcca9a00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcca415b4d0 0x7fcca41f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca3e00640 1 -- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcca406eb60 msgr2=0x7fcca40b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca3e00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcca406eb60 0x7fcca40b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca3e00640 1 -- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcca415b4d0 msgr2=0x7fcca41f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca3e00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcca415b4d0 0x7fcca41f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca3e00640 1 -- 172.21.15.100:0/3543816505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca40b12c0 con 0x7fcca40cf810 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca9a00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcca415b4d0 0x7fcca41f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca3e00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 0x7fcca40c5960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009850 tx=0x7fcc900038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca0c00640 1 -- 172.21.15.100:0/3543816505 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9003f070 con 0x7fcca40cf810 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca0c00640 1 -- 172.21.15.100:0/3543816505 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc900047a0 con 0x7fcca40cf810 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca41f4e20 con 0x7fcca40cf810 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fcca0c00640 1 -- 172.21.15.100:0/3543816505 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90035030 con 0x7fcca40cf810 2024-09-10T21:06:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.903+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca40b0580 con 0x7fcca40cf810 2024-09-10T21:06:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.905+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca40b35a0 con 0x7fcca40cf810 2024-09-10T21:06:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.906+0000 7fcca0c00640 1 -- 172.21.15.100:0/3543816505 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcc90004b90 con 0x7fcca40cf810 2024-09-10T21:06:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.907+0000 7fcca0c00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcc84077f70 0x7fcc8407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:06.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.907+0000 7fcca0c00640 1 -- 172.21.15.100:0/3543816505 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fcc900bae20 con 0x7fcca40cf810 2024-09-10T21:06:06.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.907+0000 7fcca9000640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcc84077f70 0x7fcc8407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:06.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.908+0000 7fcca9000640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcc84077f70 0x7fcc8407a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc94005fd0 tx=0x7fcc94009660 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:06.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:06.912+0000 7fcca0c00640 1 -- 172.21.15.100:0/3543816505 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcc90083290 con 0x7fcca40cf810 2024-09-10T21:06:07.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.128+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcca406cf30 con 0x7fcca40cf810 2024-09-10T21:06:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.704+0000 7fcca0c00640 1 -- 172.21.15.100:0/3543816505 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fcc90087cc0 con 0x7fcca40cf810 2024-09-10T21:06:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T21:06:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.709+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcc84077f70 msgr2=0x7fcc8407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.709+0000 7fccaba00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcc84077f70 0x7fcc8407a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc94005fd0 tx=0x7fcc94009660 comp rx=0 tx=0).stop 2024-09-10T21:06:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.709+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 msgr2=0x7fcca40c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:07.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.709+0000 7fccaba00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 0x7fcca40c5960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009850 tx=0x7fcc900038a0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.711+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 shutdown_connections 2024-09-10T21:06:07.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.711+0000 7fccaba00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcc84077f70 0x7fcc8407a430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.711+0000 7fccaba00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcca415b4d0 0x7fcca41f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.711+0000 7fccaba00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcca40cf810 0x7fcca40c5960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.711+0000 7fccaba00640 1 --2- 172.21.15.100:0/3543816505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcca406eb60 0x7fcca40b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.711+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 >> 172.21.15.100:0/3543816505 conn(0x7fcca406cb50 msgr2=0x7fcca40740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:07.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.712+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 shutdown_connections 2024-09-10T21:06:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.717+0000 7fccaba00640 1 -- 172.21.15.100:0/3543816505 wait complete. 2024-09-10T21:06:07.764 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-10T21:06:07.764 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-10T21:06:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.927+0000 7f6e08a00640 1 -- 172.21.15.100:0/324682420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 msgr2=0x7f6e0406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.927+0000 7f6e08a00640 1 --2- 172.21.15.100:0/324682420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 0x7f6e0406d510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009830 tx=0x7f6df402a480 comp rx=0 tx=0).stop 2024-09-10T21:06:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.927+0000 7f6e08a00640 1 -- 172.21.15.100:0/324682420 shutdown_connections 2024-09-10T21:06:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.927+0000 7f6e08a00640 1 --2- 172.21.15.100:0/324682420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e040cf9d0 0x7f6e04165320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.927+0000 7f6e08a00640 1 --2- 172.21.15.100:0/324682420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 0x7f6e0406d510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.927+0000 7f6e08a00640 1 -- 172.21.15.100:0/324682420 >> 172.21.15.100:0/324682420 conn(0x7f6e0406e9c0 msgr2=0x7f6e0406edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.927+0000 7f6e08a00640 1 -- 172.21.15.100:0/324682420 shutdown_connections 2024-09-10T21:06:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.927+0000 7f6e08a00640 1 -- 172.21.15.100:0/324682420 wait complete. 2024-09-10T21:06:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.928+0000 7f6e08a00640 1 Processor -- start 2024-09-10T21:06:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.928+0000 7f6e08a00640 1 -- start start 2024-09-10T21:06:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.929+0000 7f6e08a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e0406da50 0x7f6e0414c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.929+0000 7f6e08a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e040cf9d0 0x7f6e0415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.929+0000 7f6e08a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 0x7f6e0415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.929+0000 7f6e08a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6e041659e0 con 0x7f6e040cf9d0 2024-09-10T21:06:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.929+0000 7f6e08a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04165860 con 0x7f6e0415bd70 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.929+0000 7f6e08a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6e04165b60 con 0x7f6e0406da50 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e02a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e040cf9d0 0x7f6e0415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 0x7f6e0415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e0406da50 0x7f6e0414c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 0x7f6e0415acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:36786/0 (socket says 172.21.15.100:36786) 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e02a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e040cf9d0 0x7f6e0415a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52922/0 (socket says 172.21.15.100:52922) 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 -- 172.21.15.100:0/2176954768 learned_addr learned my addr 172.21.15.100:0/2176954768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 -- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e0406da50 msgr2=0x7f6e0414c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e0406da50 0x7f6e0414c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 -- 172.21.15.100:0/2176954768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e040cf9d0 msgr2=0x7f6e0415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e040cf9d0 0x7f6e0415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 -- 172.21.15.100:0/2176954768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e041f7b50 con 0x7f6e0415bd70 2024-09-10T21:06:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e02a00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e040cf9d0 0x7f6e0415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.930+0000 7f6e03e00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 0x7f6e0415acf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00eb10 tx=0x7f6dfc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.931+0000 7f6dfb400640 1 -- 172.21.15.100:0/2176954768 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc004b20 con 0x7f6e0415bd70 2024-09-10T21:06:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.931+0000 7f6dfb400640 1 -- 172.21.15.100:0/2176954768 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dfc004ce0 con 0x7f6e0415bd70 2024-09-10T21:06:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.931+0000 7f6dfb400640 1 -- 172.21.15.100:0/2176954768 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc005280 con 0x7f6e0415bd70 2024-09-10T21:06:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.931+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e041f7e30 con 0x7f6e0415bd70 2024-09-10T21:06:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.931+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e041f83f0 con 0x7f6e0415bd70 2024-09-10T21:06:07.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.932+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0406d510 con 0x7f6e0415bd70 2024-09-10T21:06:07.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.933+0000 7f6dfb400640 1 -- 172.21.15.100:0/2176954768 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6dfc03b9c0 con 0x7f6e0415bd70 2024-09-10T21:06:07.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.934+0000 7f6dfb400640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6de4077f70 0x7f6de407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:07.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.934+0000 7f6dfb400640 1 -- 172.21.15.100:0/2176954768 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6dfc09ab10 con 0x7f6e0415bd70 2024-09-10T21:06:07.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.934+0000 7f6e03400640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6de4077f70 0x7f6de407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:07.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.935+0000 7f6e03400640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6de4077f70 0x7f6de407a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6df4034000 tx=0x7f6df4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:07.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:07.938+0000 7f6dfb400640 1 -- 172.21.15.100:0/2176954768 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6dfc063030 con 0x7f6e0415bd70 2024-09-10T21:06:08.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.130+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f6e040b0030 con 0x7f6e0415bd70 2024-09-10T21:06:08.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.725+0000 7f6dfb400640 1 -- 172.21.15.100:0/2176954768 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f6dfc067a60 con 0x7f6e0415bd70 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.728+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6de4077f70 msgr2=0x7f6de407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6de4077f70 0x7f6de407a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6df4034000 tx=0x7f6df4004730 comp rx=0 tx=0).stop 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 msgr2=0x7f6e0415acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 0x7f6e0415acf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00eb10 tx=0x7f6dfc00c2d0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 shutdown_connections 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6de4077f70 0x7f6de407a430 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6df4034000 tx=0x7f6df4004730 comp rx=0 tx=0).stop 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e0415bd70 0x7f6e0415acf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e040cf9d0 0x7f6e0415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 --2- 172.21.15.100:0/2176954768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e0406da50 0x7f6e0414c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 >> 172.21.15.100:0/2176954768 conn(0x7f6e0406e9c0 msgr2=0x7f6e040b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:08.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 shutdown_connections 2024-09-10T21:06:08.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.729+0000 7f6e08a00640 1 -- 172.21.15.100:0/2176954768 wait complete. 2024-09-10T21:06:08.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T21:06:08.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.910+0000 7ffaeb400640 1 -- 172.21.15.100:0/294333759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415cf20 msgr2=0x7ffae40cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:08.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.910+0000 7ffaeb400640 1 --2- 172.21.15.100:0/294333759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415cf20 0x7ffae40cc240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffad0005fd0 tx=0x7ffad002a5d0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.911+0000 7ffaeb400640 1 -- 172.21.15.100:0/294333759 shutdown_connections 2024-09-10T21:06:08.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.911+0000 7ffaeb400640 1 --2- 172.21.15.100:0/294333759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415cf20 0x7ffae40cc240 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.911+0000 7ffaeb400640 1 --2- 172.21.15.100:0/294333759 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffae41594e0 0x7ffae406ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.911+0000 7ffaeb400640 1 -- 172.21.15.100:0/294333759 >> 172.21.15.100:0/294333759 conn(0x7ffae40cf820 msgr2=0x7ffae40cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:08.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.911+0000 7ffaeb400640 1 -- 172.21.15.100:0/294333759 shutdown_connections 2024-09-10T21:06:08.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.911+0000 7ffaeb400640 1 -- 172.21.15.100:0/294333759 wait complete. 2024-09-10T21:06:08.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.912+0000 7ffaeb400640 1 Processor -- start 2024-09-10T21:06:08.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.912+0000 7ffaeb400640 1 -- start start 2024-09-10T21:06:08.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.913+0000 7ffaeb400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffae41594e0 0x7ffae4151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.913+0000 7ffaeb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffae415cf20 0x7ffae41f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.913+0000 7ffaeb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415f400 0x7ffae41535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.913+0000 7ffaeb400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffae40ce780 con 0x7ffae415f400 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.913+0000 7ffaeb400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffae415fc60 con 0x7ffae415cf20 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.913+0000 7ffaeb400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffae40ce900 con 0x7ffae41594e0 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415f400 0x7ffae41535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415f400 0x7ffae41535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52932/0 (socket says 172.21.15.100:52932) 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 -- 172.21.15.100:0/4250301949 learned_addr learned my addr 172.21.15.100:0/4250301949 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae8a00640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffae41594e0 0x7ffae4151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae3e00640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffae415cf20 0x7ffae41f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 -- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffae41594e0 msgr2=0x7ffae4151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffae41594e0 0x7ffae4151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 -- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffae415cf20 msgr2=0x7ffae41f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffae415cf20 0x7ffae41f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 -- 172.21.15.100:0/4250301949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae4152280 con 0x7ffae415f400 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae3e00640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffae415cf20 0x7ffae41f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae9400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415f400 0x7ffae41535d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c3c0 tx=0x7ffadc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.914+0000 7ffae0c00640 1 -- 172.21.15.100:0/4250301949 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc017070 con 0x7ffae415f400 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.915+0000 7ffae0c00640 1 -- 172.21.15.100:0/4250301949 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffadc0053c0 con 0x7ffae415f400 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.915+0000 7ffae0c00640 1 -- 172.21.15.100:0/4250301949 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc003850 con 0x7ffae415f400 2024-09-10T21:06:08.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.915+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae414f590 con 0x7ffae415f400 2024-09-10T21:06:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.915+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae414fb50 con 0x7ffae415f400 2024-09-10T21:06:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.916+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffae40cee20 con 0x7ffae415f400 2024-09-10T21:06:08.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.917+0000 7ffae0c00640 1 -- 172.21.15.100:0/4250301949 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffadc0039f0 con 0x7ffae415f400 2024-09-10T21:06:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.917+0000 7ffae0c00640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffac4077f70 0x7ffac407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.918+0000 7ffae0c00640 1 -- 172.21.15.100:0/4250301949 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7ffadc099420 con 0x7ffae415f400 2024-09-10T21:06:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.918+0000 7ffae8a00640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffac4077f70 0x7ffac407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.919+0000 7ffae8a00640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffac4077f70 0x7ffac407a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffad4005fd0 tx=0x7ffad40098b0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:08.922+0000 7ffae0c00640 1 -- 172.21.15.100:0/4250301949 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffadc061d50 con 0x7ffae415f400 2024-09-10T21:06:09.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:09.106+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ffae40cc440 con 0x7ffae415f400 2024-09-10T21:06:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.734+0000 7ffae0c00640 1 -- 172.21.15.100:0/4250301949 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7ffadc061650 con 0x7ffae415f400 2024-09-10T21:06:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_ec' created 2024-09-10T21:06:10.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.739+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffac4077f70 msgr2=0x7ffac407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.739+0000 7ffaeb400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffac4077f70 0x7ffac407a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffad4005fd0 tx=0x7ffad40098b0 comp rx=0 tx=0).stop 2024-09-10T21:06:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.739+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415f400 msgr2=0x7ffae41535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.739+0000 7ffaeb400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415f400 0x7ffae41535d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c3c0 tx=0x7ffadc00c880 comp rx=0 tx=0).stop 2024-09-10T21:06:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.740+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 shutdown_connections 2024-09-10T21:06:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.740+0000 7ffaeb400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae415f400 0x7ffae41535d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.740+0000 7ffaeb400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffac4077f70 0x7ffac407a430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.740+0000 7ffaeb400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffae415cf20 0x7ffae41f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.740+0000 7ffaeb400640 1 --2- 172.21.15.100:0/4250301949 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffae41594e0 0x7ffae4151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:10.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.740+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 >> 172.21.15.100:0/4250301949 conn(0x7ffae40cf820 msgr2=0x7ffae4073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:10.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.740+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 shutdown_connections 2024-09-10T21:06:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.741+0000 7ffaeb400640 1 -- 172.21.15.100:0/4250301949 wait complete. 2024-09-10T21:06:10.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-10T21:06:10.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.929+0000 7f2276a00640 1 -- 172.21.15.100:0/95353014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2258004040 msgr2=0x7f2258004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:10.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.929+0000 7f2276a00640 1 --2- 172.21.15.100:0/95353014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2258004040 0x7f2258004800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f225c009b50 tx=0x7f2258005830 comp rx=0 tx=0).stop 2024-09-10T21:06:10.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.929+0000 7f2276000640 1 -- 172.21.15.100:0/95353014 reap_dead start 2024-09-10T21:06:10.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.929+0000 7f2276a00640 1 -- 172.21.15.100:0/95353014 shutdown_connections 2024-09-10T21:06:10.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.929+0000 7f2276a00640 1 -- 172.21.15.100:0/95353014 >> 172.21.15.100:0/95353014 conn(0x7f227006d500 msgr2=0x7f22700b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:10.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.929+0000 7f2276a00640 1 -- 172.21.15.100:0/95353014 shutdown_connections 2024-09-10T21:06:10.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.929+0000 7f2276a00640 1 -- 172.21.15.100:0/95353014 wait complete. 2024-09-10T21:06:10.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.931+0000 7f2276a00640 1 Processor -- start 2024-09-10T21:06:10.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.931+0000 7f2276a00640 1 -- start start 2024-09-10T21:06:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.931+0000 7f2276a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2258004040 0x7f227015d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227015d5a0 0x7f22700c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700c9330 0x7f22701f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f22701601c0 con 0x7f22700c9330 2024-09-10T21:06:10.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f22700af020 con 0x7f227015d5a0 2024-09-10T21:06:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f227015bcd0 con 0x7f2258004040 2024-09-10T21:06:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700c9330 0x7f22701f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700c9330 0x7f22701f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52958/0 (socket says 172.21.15.100:52958) 2024-09-10T21:06:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 -- 172.21.15.100:0/188357735 learned_addr learned my addr 172.21.15.100:0/188357735 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2275600640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2258004040 0x7f227015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2274c00640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227015d5a0 0x7f22700c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 -- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2258004040 msgr2=0x7f227015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:10.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2258004040 0x7f227015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 -- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227015d5a0 msgr2=0x7f22700c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227015d5a0 0x7f22700c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 -- 172.21.15.100:0/188357735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22701433e0 con 0x7f22700c9330 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.932+0000 7f2276000640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700c9330 0x7f22701f5820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f227015ce40 tx=0x7f2268006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.933+0000 7f226d600640 1 -- 172.21.15.100:0/188357735 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264009720 con 0x7f22700c9330 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.933+0000 7f226d600640 1 -- 172.21.15.100:0/188357735 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2268018070 con 0x7f22700c9330 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.933+0000 7f226d600640 1 -- 172.21.15.100:0/188357735 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226800fd00 con 0x7f22700c9330 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.933+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22701436c0 con 0x7f22700c9330 2024-09-10T21:06:10.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.933+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2270143c80 con 0x7f22700c9330 2024-09-10T21:06:10.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.934+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2270073610 con 0x7f22700c9330 2024-09-10T21:06:10.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.935+0000 7f226d600640 1 -- 172.21.15.100:0/188357735 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f226801d460 con 0x7f22700c9330 2024-09-10T21:06:10.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.936+0000 7f226d600640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2250077f70 0x7f225007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:10.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.936+0000 7f226d600640 1 -- 172.21.15.100:0/188357735 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f226809a6a0 con 0x7f22700c9330 2024-09-10T21:06:10.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.936+0000 7f2275600640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2250077f70 0x7f225007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:10.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.937+0000 7f2275600640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2250077f70 0x7f225007a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2264009df0 tx=0x7f2264005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:10.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:10.941+0000 7f226d600640 1 -- 172.21.15.100:0/188357735 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2268062de0 con 0x7f22700c9330 2024-09-10T21:06:11.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.125+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f227015b0a0 con 0x7f22700c9330 2024-09-10T21:06:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.736+0000 7f226d600640 1 -- 172.21.15.100:0/188357735 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7f22680626e0 con 0x7f22700c9330 2024-09-10T21:06:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:set pool 4 allow_ec_overwrites to true 2024-09-10T21:06:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2250077f70 msgr2=0x7f225007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2250077f70 0x7f225007a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2264009df0 tx=0x7f2264005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700c9330 msgr2=0x7f22701f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700c9330 0x7f22701f5820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f227015ce40 tx=0x7f2268006660 comp rx=0 tx=0).stop 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 shutdown_connections 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700c9330 0x7f22701f5820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2250077f70 0x7f225007a430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227015d5a0 0x7f22700c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 --2- 172.21.15.100:0/188357735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2258004040 0x7f227015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 >> 172.21.15.100:0/188357735 conn(0x7f227006d500 msgr2=0x7f22700cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 shutdown_connections 2024-09-10T21:06:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.739+0000 7f2276a00640 1 -- 172.21.15.100:0/188357735 wait complete. 2024-09-10T21:06:11.778 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-10T21:06:11.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.935+0000 7f5000c00640 1 -- 172.21.15.100:0/2995931292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc15c750 msgr2=0x7f4ffc0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:11.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.935+0000 7f5000c00640 1 --2- 172.21.15.100:0/2995931292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc15c750 0x7f4ffc0cf780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc070770 tx=0x7f4ff402aa30 comp rx=0 tx=0).stop 2024-09-10T21:06:11.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.935+0000 7f5000c00640 1 -- 172.21.15.100:0/2995931292 shutdown_connections 2024-09-10T21:06:11.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.935+0000 7f5000c00640 1 --2- 172.21.15.100:0/2995931292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc15c750 0x7f4ffc0cf780 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:11.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.935+0000 7f5000c00640 1 --2- 172.21.15.100:0/2995931292 >> v2:172.21.15.130:3300/0 conn(0x7f4ffc15b680 0x7f4ffc15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:11.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.935+0000 7f5000c00640 1 -- 172.21.15.100:0/2995931292 >> 172.21.15.100:0/2995931292 conn(0x7f4ffc06cb50 msgr2=0x7f4ffc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:11.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.935+0000 7f5000c00640 1 -- 172.21.15.100:0/2995931292 shutdown_connections 2024-09-10T21:06:11.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.935+0000 7f5000c00640 1 -- 172.21.15.100:0/2995931292 wait complete. 2024-09-10T21:06:11.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.937+0000 7f5000c00640 1 Processor -- start 2024-09-10T21:06:11.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.937+0000 7f5000c00640 1 -- start start 2024-09-10T21:06:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f5000c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0741e0 0x7f4ffc147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f5000c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ffc15b680 0x7f4ffc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f5000c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ffc15c750 0x7f4ffc1f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f5000c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc0b2860 con 0x7f4ffc0741e0 2024-09-10T21:06:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f5000c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc0b29e0 con 0x7f4ffc15b680 2024-09-10T21:06:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f5000c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ffc0b2b60 con 0x7f4ffc15c750 2024-09-10T21:06:11.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0741e0 0x7f4ffc147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0741e0 0x7f4ffc147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46842/0 (socket says 172.21.15.100:46842) 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9e00640 1 -- 172.21.15.100:0/3933679676 learned_addr learned my addr 172.21.15.100:0/3933679676 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9400640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ffc15b680 0x7f4ffc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ffa800640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ffc15c750 0x7f4ffc1f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9e00640 1 -- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ffc15c750 msgr2=0x7f4ffc1f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9e00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ffc15c750 0x7f4ffc1f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9e00640 1 -- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ffc15b680 msgr2=0x7f4ffc1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9e00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ffc15b680 0x7f4ffc1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.938+0000 7f4ff9e00640 1 -- 172.21.15.100:0/3933679676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc159fb0 con 0x7f4ffc0741e0 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.939+0000 7f4ff9e00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0741e0 0x7f4ffc147690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00ea20 tx=0x7f4fec00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:11.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.939+0000 7f4ff2000640 1 -- 172.21.15.100:0/3933679676 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00cd80 con 0x7f4ffc0741e0 2024-09-10T21:06:11.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.939+0000 7f4ff2000640 1 -- 172.21.15.100:0/3933679676 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fec010430 con 0x7f4ffc0741e0 2024-09-10T21:06:11.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.939+0000 7f4ff2000640 1 -- 172.21.15.100:0/3933679676 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec010840 con 0x7f4ffc0741e0 2024-09-10T21:06:11.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.939+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ffc15a290 con 0x7f4ffc0741e0 2024-09-10T21:06:11.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.939+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ffc15a850 con 0x7f4ffc0741e0 2024-09-10T21:06:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.940+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ffc0b3080 con 0x7f4ffc0741e0 2024-09-10T21:06:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.941+0000 7f4ff2000640 1 -- 172.21.15.100:0/3933679676 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4fec0109e0 con 0x7f4ffc0741e0 2024-09-10T21:06:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.942+0000 7f4ff2000640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fdc077fa0 0x7f4fdc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.942+0000 7f4ff2000640 1 -- 172.21.15.100:0/3933679676 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f4fec09ab20 con 0x7f4ffc0741e0 2024-09-10T21:06:11.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.943+0000 7f4ff9400640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fdc077fa0 0x7f4fdc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:11.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.943+0000 7f4ff9400640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fdc077fa0 0x7f4fdc07a460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc1eb6d0 tx=0x7f4fe8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:11.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:11.947+0000 7f4ff2000640 1 -- 172.21.15.100:0/3933679676 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4fec062ca0 con 0x7f4ffc0741e0 2024-09-10T21:06:12.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.165+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f4ffc0cc490 con 0x7f4ffc0741e0 2024-09-10T21:06:12.694 INFO:tasks.ceph.mds.b.smithi130.stderr:2024-09-10T21:06:12.690+0000 7eff64800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T21:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.756+0000 7f4ff2000640 1 -- 172.21.15.100:0/3933679676 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f4fec0676d0 con 0x7f4ffc0741e0 2024-09-10T21:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:added data pool 4 to fsmap 2024-09-10T21:06:12.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fdc077fa0 msgr2=0x7f4fdc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fdc077fa0 0x7f4fdc07a460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc1eb6d0 tx=0x7f4fe8009040 comp rx=0 tx=0).stop 2024-09-10T21:06:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0741e0 msgr2=0x7f4ffc147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0741e0 0x7f4ffc147690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00ea20 tx=0x7f4fec00eee0 comp rx=0 tx=0).stop 2024-09-10T21:06:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 shutdown_connections 2024-09-10T21:06:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ffc15c750 0x7f4ffc1f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fdc077fa0 0x7f4fdc07a460 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ffc15b680 0x7f4ffc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 --2- 172.21.15.100:0/3933679676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0741e0 0x7f4ffc147690 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 >> 172.21.15.100:0/3933679676 conn(0x7f4ffc06cb50 msgr2=0x7f4ffc0cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 shutdown_connections 2024-09-10T21:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.759+0000 7f5000c00640 1 -- 172.21.15.100:0/3933679676 wait complete. 2024-09-10T21:06:12.780 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.936+0000 7fb181000640 1 -- 172.21.15.100:0/233352056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 msgr2=0x7fb17c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.936+0000 7fb181000640 1 --2- 172.21.15.100:0/233352056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 0x7fb17c15ba60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb16c005fd0 tx=0x7fb16c02aa00 comp rx=0 tx=0).stop 2024-09-10T21:06:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.936+0000 7fb181000640 1 -- 172.21.15.100:0/233352056 shutdown_connections 2024-09-10T21:06:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.936+0000 7fb181000640 1 --2- 172.21.15.100:0/233352056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 0x7fb17c15ba60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.936+0000 7fb181000640 1 -- 172.21.15.100:0/233352056 >> 172.21.15.100:0/233352056 conn(0x7fb17c06cb50 msgr2=0x7fb17c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.936+0000 7fb181000640 1 -- 172.21.15.100:0/233352056 shutdown_connections 2024-09-10T21:06:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.936+0000 7fb181000640 1 -- 172.21.15.100:0/233352056 wait complete. 2024-09-10T21:06:12.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.938+0000 7fb181000640 1 Processor -- start 2024-09-10T21:06:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.938+0000 7fb181000640 1 -- start start 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb181000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb17c0741e0 0x7fb17c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb181000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 0x7fb17c0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb181000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb17c15c750 0x7fb17c159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb181000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c0b2bf0 con 0x7fb17c15b680 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb181000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c0b2a70 con 0x7fb17c0741e0 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb181000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb17c0b2d70 con 0x7fb17c15c750 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 0x7fb17c0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 0x7fb17c0c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46866/0 (socket says 172.21.15.100:46866) 2024-09-10T21:06:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179400640 1 -- 172.21.15.100:0/1915335167 learned_addr learned my addr 172.21.15.100:0/1915335167 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179e00640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb17c0741e0 0x7fb17c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb17a800640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb17c15c750 0x7fb17c159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179400640 1 -- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb17c15c750 msgr2=0x7fb17c159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179400640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb17c15c750 0x7fb17c159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179400640 1 -- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb17c0741e0 msgr2=0x7fb17c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179400640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb17c0741e0 0x7fb17c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb179400640 1 -- 172.21.15.100:0/1915335167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c0c5270 con 0x7fb17c15b680 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.939+0000 7fb17a800640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb17c15c750 0x7fb17c159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.940+0000 7fb179400640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 0x7fb17c0c47d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb16800c430 tx=0x7fb16800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.940+0000 7fb172000640 1 -- 172.21.15.100:0/1915335167 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168011790 con 0x7fb17c15b680 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.940+0000 7fb172000640 1 -- 172.21.15.100:0/1915335167 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb168017070 con 0x7fb17c15b680 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.940+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c0c5550 con 0x7fb17c15b680 2024-09-10T21:06:12.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.940+0000 7fb172000640 1 -- 172.21.15.100:0/1915335167 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168011d00 con 0x7fb17c15b680 2024-09-10T21:06:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.940+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c0c5b10 con 0x7fb17c15b680 2024-09-10T21:06:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.941+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17c15f4d0 con 0x7fb17c15b680 2024-09-10T21:06:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.942+0000 7fb172000640 1 -- 172.21.15.100:0/1915335167 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb16801c460 con 0x7fb17c15b680 2024-09-10T21:06:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.944+0000 7fb172000640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb15c077f70 0x7fb15c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.944+0000 7fb172000640 1 -- 172.21.15.100:0/1915335167 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb168099f30 con 0x7fb17c15b680 2024-09-10T21:06:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.944+0000 7fb179e00640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb15c077f70 0x7fb15c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.945+0000 7fb179e00640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb15c077f70 0x7fb15c07a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb16c035000 tx=0x7fb16c03a040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:12.947+0000 7fb172000640 1 -- 172.21.15.100:0/1915335167 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb1680626f0 con 0x7fb17c15b680 2024-09-10T21:06:13.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.174+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb17c0cc490 con 0x7fb17c15b680 2024-09-10T21:06:13.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.175+0000 7fb172000640 1 -- 172.21.15.100:0/1915335167 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5231 (secure 0 0 0) 0x7fb168061ff0 con 0x7fb17c15b680 2024-09-10T21:06:13.179 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:13.179 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"btime":"2024-09-10T21:06:12:746774+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:12.166991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:13.179 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.177+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb15c077f70 msgr2=0x7fb15c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.177+0000 7fb181000640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb15c077f70 0x7fb15c07a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb16c035000 tx=0x7fb16c03a040 comp rx=0 tx=0).stop 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.177+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 msgr2=0x7fb17c0c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.177+0000 7fb181000640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 0x7fb17c0c47d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb16800c430 tx=0x7fb16800c8f0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.178+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 shutdown_connections 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.178+0000 7fb181000640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb17c15c750 0x7fb17c159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.178+0000 7fb181000640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb17c15b680 0x7fb17c0c47d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.178+0000 7fb181000640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb15c077f70 0x7fb15c07a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.178+0000 7fb181000640 1 --2- 172.21.15.100:0/1915335167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb17c0741e0 0x7fb17c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.178+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 >> 172.21.15.100:0/1915335167 conn(0x7fb17c06cb50 msgr2=0x7fb17c15e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.178+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 shutdown_connections 2024-09-10T21:06:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.178+0000 7fb181000640 1 -- 172.21.15.100:0/1915335167 wait complete. 2024-09-10T21:06:13.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:13.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.350+0000 7f1279600640 1 -- 172.21.15.100:0/3488585905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580052e0 msgr2=0x7f125800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.350+0000 7f1279600640 1 --2- 172.21.15.100:0/3488585905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580052e0 0x7f125800b9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c610 tx=0x7f1258005830 comp rx=0 tx=0).stop 2024-09-10T21:06:13.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.351+0000 7f1279600640 1 -- 172.21.15.100:0/3488585905 shutdown_connections 2024-09-10T21:06:13.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.351+0000 7f1279600640 1 --2- 172.21.15.100:0/3488585905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580052e0 0x7f125800b9c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.351+0000 7f1279600640 1 -- 172.21.15.100:0/3488585905 >> 172.21.15.100:0/3488585905 conn(0x7f127406cb50 msgr2=0x7f127406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:13.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.351+0000 7f1279600640 1 -- 172.21.15.100:0/3488585905 shutdown_connections 2024-09-10T21:06:13.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.351+0000 7f1279600640 1 -- 172.21.15.100:0/3488585905 wait complete. 2024-09-10T21:06:13.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.352+0000 7f1279600640 1 Processor -- start 2024-09-10T21:06:13.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.352+0000 7f1279600640 1 -- start start 2024-09-10T21:06:13.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.353+0000 7f1279600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12580052e0 0x7f12741f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:13.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.353+0000 7f1279600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1274150730 0x7f1274153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.353+0000 7f1279600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1274150b90 0x7f12741539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.353+0000 7f1279600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f127415f650 con 0x7f1274150730 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.353+0000 7f1279600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f127415f4d0 con 0x7f12580052e0 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.353+0000 7f1279600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f127415f7d0 con 0x7f1274150b90 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.353+0000 7f1272000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1274150730 0x7f1274153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1274150730 0x7f1274153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46878/0 (socket says 172.21.15.100:46878) 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272000640 1 -- 172.21.15.100:0/1519847194 learned_addr learned my addr 172.21.15.100:0/1519847194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272a00640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12580052e0 0x7f12741f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1273400640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1274150b90 0x7f12741539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272000640 1 -- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1274150b90 msgr2=0x7f12741539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272000640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1274150b90 0x7f12741539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272000640 1 -- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12580052e0 msgr2=0x7f12741f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272000640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12580052e0 0x7f12741f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272000640 1 -- 172.21.15.100:0/1519847194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12741f3b10 con 0x7f1274150730 2024-09-10T21:06:13.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1273400640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1274150b90 0x7f12741539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:13.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1272000640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1274150730 0x7f1274153460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1260004e50 tx=0x7f1260001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:13.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f126aa00640 1 -- 172.21.15.100:0/1519847194 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260001d40 con 0x7f1274150730 2024-09-10T21:06:13.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f126aa00640 1 -- 172.21.15.100:0/1519847194 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1260016070 con 0x7f1274150730 2024-09-10T21:06:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.354+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12741f6850 con 0x7f1274150730 2024-09-10T21:06:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.355+0000 7f126aa00640 1 -- 172.21.15.100:0/1519847194 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260010b20 con 0x7f1274150730 2024-09-10T21:06:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.355+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127414e2d0 con 0x7f1274150730 2024-09-10T21:06:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.356+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12740cc490 con 0x7f1274150730 2024-09-10T21:06:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.357+0000 7f126aa00640 1 -- 172.21.15.100:0/1519847194 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1260010cc0 con 0x7f1274150730 2024-09-10T21:06:13.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.358+0000 7f126aa00640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1254077f70 0x7f125407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:13.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.358+0000 7f126aa00640 1 -- 172.21.15.100:0/1519847194 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f126009a8d0 con 0x7f1274150730 2024-09-10T21:06:13.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.358+0000 7f1272a00640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1254077f70 0x7f125407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:13.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.359+0000 7f1272a00640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1254077f70 0x7f125407a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1264009bd0 tx=0x7f1264005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:13.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.362+0000 7f126aa00640 1 -- 172.21.15.100:0/1519847194 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1260063080 con 0x7f1274150730 2024-09-10T21:06:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.546+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12740ce9b0 con 0x7f1274150730 2024-09-10T21:06:13.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.547+0000 7f126aa00640 1 -- 172.21.15.100:0/1519847194 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f1260062980 con 0x7f1274150730 2024-09-10T21:06:13.551 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:13.551 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:13.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1254077f70 msgr2=0x7f125407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1254077f70 0x7f125407a430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1264009bd0 tx=0x7f1264005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1274150730 msgr2=0x7f1274153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1274150730 0x7f1274153460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1260004e50 tx=0x7f1260001630 comp rx=0 tx=0).stop 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 shutdown_connections 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1274150b90 0x7f12741539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1274150730 0x7f1274153460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1254077f70 0x7f125407a430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 --2- 172.21.15.100:0/1519847194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12580052e0 0x7f12741f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 >> 172.21.15.100:0/1519847194 conn(0x7f127406cb50 msgr2=0x7f127415e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 shutdown_connections 2024-09-10T21:06:13.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.550+0000 7f1279600640 1 -- 172.21.15.100:0/1519847194 wait complete. 2024-09-10T21:06:13.570 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:13.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.723+0000 7fec4aa00640 1 -- 172.21.15.100:0/1250425184 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec440cf850 msgr2=0x7fec440cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.723+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1250425184 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec440cf850 0x7fec440cfc30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fec34009830 tx=0x7fec3402a480 comp rx=0 tx=0).stop 2024-09-10T21:06:13.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.723+0000 7fec4aa00640 1 -- 172.21.15.100:0/1250425184 shutdown_connections 2024-09-10T21:06:13.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.723+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1250425184 >> v2:172.21.15.130:3300/0 conn(0x7fec440cdb30 0x7fec44160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.723+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1250425184 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec440cf850 0x7fec440cfc30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.723+0000 7fec4aa00640 1 -- 172.21.15.100:0/1250425184 >> 172.21.15.100:0/1250425184 conn(0x7fec440d1a10 msgr2=0x7fec440d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:13.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.723+0000 7fec4aa00640 1 -- 172.21.15.100:0/1250425184 shutdown_connections 2024-09-10T21:06:13.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.723+0000 7fec4aa00640 1 -- 172.21.15.100:0/1250425184 wait complete. 2024-09-10T21:06:13.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.724+0000 7fec4aa00640 1 Processor -- start 2024-09-10T21:06:13.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.725+0000 7fec4aa00640 1 -- start start 2024-09-10T21:06:13.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.725+0000 7fec4aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec440cd6f0 0x7fec440c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:13.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.725+0000 7fec4aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec440cdb30 0x7fec44154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:13.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.725+0000 7fec4aa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec440cf850 0x7fec4415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:13.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.725+0000 7fec4aa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fec440ce3f0 con 0x7fec440cd6f0 2024-09-10T21:06:13.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.725+0000 7fec4aa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec440ce270 con 0x7fec440cdb30 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.725+0000 7fec4aa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fec440ce570 con 0x7fec440cf850 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec440cd6f0 0x7fec440c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec440cd6f0 0x7fec440c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46890/0 (socket says 172.21.15.100:46890) 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 -- 172.21.15.100:0/1654180336 learned_addr learned my addr 172.21.15.100:0/1654180336 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec48a00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec440cf850 0x7fec4415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec3be00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec440cdb30 0x7fec44154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 -- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec440cf850 msgr2=0x7fec4415d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec440cf850 0x7fec4415d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 -- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec440cdb30 msgr2=0x7fec44154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec440cdb30 0x7fec44154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 -- 172.21.15.100:0/1654180336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec440c5ac0 con 0x7fec440cd6f0 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec3be00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec440cdb30 0x7fec44154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.726+0000 7fec43e00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec440cd6f0 0x7fec440c6900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec34009950 tx=0x7fec34033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.727+0000 7fec40c00640 1 -- 172.21.15.100:0/1654180336 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34005c90 con 0x7fec440cd6f0 2024-09-10T21:06:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.727+0000 7fec40c00640 1 -- 172.21.15.100:0/1654180336 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec34031e50 con 0x7fec440cd6f0 2024-09-10T21:06:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.727+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec440b49e0 con 0x7fec440cd6f0 2024-09-10T21:06:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.727+0000 7fec40c00640 1 -- 172.21.15.100:0/1654180336 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34005260 con 0x7fec440cd6f0 2024-09-10T21:06:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.727+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec44155390 con 0x7fec440cd6f0 2024-09-10T21:06:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.728+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec440cfc30 con 0x7fec440cd6f0 2024-09-10T21:06:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.729+0000 7fec40c00640 1 -- 172.21.15.100:0/1654180336 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fec34005400 con 0x7fec440cd6f0 2024-09-10T21:06:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.730+0000 7fec40c00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fec20077f70 0x7fec2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.730+0000 7fec40c00640 1 -- 172.21.15.100:0/1654180336 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fec340bafe0 con 0x7fec440cd6f0 2024-09-10T21:06:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.731+0000 7fec3be00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fec20077f70 0x7fec2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.731+0000 7fec3be00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fec20077f70 0x7fec2007a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fec440c6e40 tx=0x7fec2c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.735+0000 7fec40c00640 1 -- 172.21.15.100:0/1654180336 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fec3403f030 con 0x7fec440cd6f0 2024-09-10T21:06:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.920+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec440c50a0 con 0x7fec440cd6f0 2024-09-10T21:06:13.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.921+0000 7fec40c00640 1 -- 172.21.15.100:0/1654180336 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fec340830f0 con 0x7fec440cd6f0 2024-09-10T21:06:13.925 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:13.925 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fec20077f70 msgr2=0x7fec2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fec20077f70 0x7fec2007a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fec440c6e40 tx=0x7fec2c009040 comp rx=0 tx=0).stop 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec440cd6f0 msgr2=0x7fec440c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec440cd6f0 0x7fec440c6900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec34009950 tx=0x7fec34033c20 comp rx=0 tx=0).stop 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 shutdown_connections 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec440cf850 0x7fec4415d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fec20077f70 0x7fec2007a430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec440cdb30 0x7fec44154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 --2- 172.21.15.100:0/1654180336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec440cd6f0 0x7fec440c6900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 >> 172.21.15.100:0/1654180336 conn(0x7fec440d1a10 msgr2=0x7fec440af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 shutdown_connections 2024-09-10T21:06:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:13.924+0000 7fec4aa00640 1 -- 172.21.15.100:0/1654180336 wait complete. 2024-09-10T21:06:13.961 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.112+0000 7f7ce0e00640 1 -- 172.21.15.100:0/1611648294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0cec80 msgr2=0x7f7cdc15bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.112+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/1611648294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0cec80 0x7f7cdc15bcd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0cc040 tx=0x7f7cc802a5f0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.112+0000 7f7ce0e00640 1 -- 172.21.15.100:0/1611648294 shutdown_connections 2024-09-10T21:06:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.112+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/1611648294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0cec80 0x7f7cdc15bcd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.112+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/1611648294 >> v2:172.21.15.130:3300/0 conn(0x7f7cdc0aea30 0x7f7cdc073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.112+0000 7f7ce0e00640 1 -- 172.21.15.100:0/1611648294 >> 172.21.15.100:0/1611648294 conn(0x7f7cdc06d500 msgr2=0x7f7cdc0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.112+0000 7f7ce0e00640 1 -- 172.21.15.100:0/1611648294 shutdown_connections 2024-09-10T21:06:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.112+0000 7f7ce0e00640 1 -- 172.21.15.100:0/1611648294 wait complete. 2024-09-10T21:06:14.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.114+0000 7f7ce0e00640 1 Processor -- start 2024-09-10T21:06:14.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.114+0000 7f7ce0e00640 1 -- start start 2024-09-10T21:06:14.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7ce0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0aea30 0x7f7cdc1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:14.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7ce0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc0cec80 0x7f7cdc14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:14.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7ce0e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cdc15c210 0x7f7cdc0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:14.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7ce0e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0aef90 con 0x7f7cdc0aea30 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7ce0e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0aee10 con 0x7f7cdc0cec80 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7ce0e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc0cc110 con 0x7f7cdc15c210 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7cdb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0aea30 0x7f7cdc1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7cdb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0aea30 0x7f7cdc1558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46906/0 (socket says 172.21.15.100:46906) 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7cdb400640 1 -- 172.21.15.100:0/2022360497 learned_addr learned my addr 172.21.15.100:0/2022360497 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7cdb400640 1 -- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cdc15c210 msgr2=0x7f7cdc0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7cdb400640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cdc15c210 0x7f7cdc0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7cdb400640 1 -- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc0cec80 msgr2=0x7f7cdc14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.115+0000 7f7cdaa00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc0cec80 0x7f7cdc14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7cdb400640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc0cec80 0x7f7cdc14fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7cdb400640 1 -- 172.21.15.100:0/2022360497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc1501b0 con 0x7f7cdc0aea30 2024-09-10T21:06:14.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7cdaa00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc0cec80 0x7f7cdc14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:14.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7cdb400640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0aea30 0x7f7cdc1558c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00db00 tx=0x7f7ccc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:14.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7cd3400640 1 -- 172.21.15.100:0/2022360497 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc017070 con 0x7f7cdc0aea30 2024-09-10T21:06:14.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7cd3400640 1 -- 172.21.15.100:0/2022360497 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ccc003970 con 0x7f7cdc0aea30 2024-09-10T21:06:14.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc0b2820 con 0x7f7cdc0aea30 2024-09-10T21:06:14.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7cd3400640 1 -- 172.21.15.100:0/2022360497 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc003dc0 con 0x7f7cdc0aea30 2024-09-10T21:06:14.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.116+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc0b2de0 con 0x7f7cdc0aea30 2024-09-10T21:06:14.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.117+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cdc073610 con 0x7f7cdc0aea30 2024-09-10T21:06:14.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.118+0000 7f7cd3400640 1 -- 172.21.15.100:0/2022360497 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7ccc004020 con 0x7f7cdc0aea30 2024-09-10T21:06:14.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.120+0000 7f7cd3400640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7cbc077f70 0x7f7cbc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:14.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.120+0000 7f7cd3400640 1 -- 172.21.15.100:0/2022360497 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7ccc09a7a0 con 0x7f7cdc0aea30 2024-09-10T21:06:14.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.120+0000 7f7cdaa00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7cbc077f70 0x7f7cbc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:14.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.121+0000 7f7cdaa00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7cbc077f70 0x7f7cbc07a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8033000 tx=0x7f7cc8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:14.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.124+0000 7f7cd3400640 1 -- 172.21.15.100:0/2022360497 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7ccc020030 con 0x7f7cdc0aea30 2024-09-10T21:06:14.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.340+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cdc0cd270 con 0x7f7cdc0aea30 2024-09-10T21:06:14.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.341+0000 7f7cd3400640 1 -- 172.21.15.100:0/2022360497 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5231 (secure 0 0 0) 0x7f7ccc062ff0 con 0x7f7cdc0aea30 2024-09-10T21:06:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:14.345 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"btime":"2024-09-10T21:06:12:746774+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:12.166991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:14.345 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-09-10T21:06:14.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.343+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7cbc077f70 msgr2=0x7f7cbc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.343+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7cbc077f70 0x7f7cbc07a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8033000 tx=0x7f7cc8004730 comp rx=0 tx=0).stop 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.343+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0aea30 msgr2=0x7f7cdc1558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.343+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0aea30 0x7f7cdc1558c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00db00 tx=0x7f7ccc00b260 comp rx=0 tx=0).stop 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.343+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 shutdown_connections 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.343+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cdc15c210 0x7f7cdc0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.343+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7cbc077f70 0x7f7cbc07a430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.343+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc0cec80 0x7f7cdc14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.344+0000 7f7ce0e00640 1 --2- 172.21.15.100:0/2022360497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cdc0aea30 0x7f7cdc1558c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.344+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 >> 172.21.15.100:0/2022360497 conn(0x7f7cdc06d500 msgr2=0x7f7cdc0b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.344+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 shutdown_connections 2024-09-10T21:06:14.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.344+0000 7f7ce0e00640 1 -- 172.21.15.100:0/2022360497 wait complete. 2024-09-10T21:06:14.362 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:14.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.516+0000 7fb859800640 1 -- 172.21.15.100:0/4164663191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838004800 msgr2=0x7fb838004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.516+0000 7fb859800640 1 --2- 172.21.15.100:0/4164663191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838004800 0x7fb838004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb840006f70 tx=0x7fb838005830 comp rx=0 tx=0).stop 2024-09-10T21:06:14.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.516+0000 7fb859800640 1 -- 172.21.15.100:0/4164663191 shutdown_connections 2024-09-10T21:06:14.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.516+0000 7fb859800640 1 --2- 172.21.15.100:0/4164663191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838004800 0x7fb838004c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.516+0000 7fb859800640 1 -- 172.21.15.100:0/4164663191 >> 172.21.15.100:0/4164663191 conn(0x7fb85406cb50 msgr2=0x7fb85406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:14.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.516+0000 7fb859800640 1 -- 172.21.15.100:0/4164663191 shutdown_connections 2024-09-10T21:06:14.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.516+0000 7fb859800640 1 -- 172.21.15.100:0/4164663191 wait complete. 2024-09-10T21:06:14.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.518+0000 7fb859800640 1 Processor -- start 2024-09-10T21:06:14.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.518+0000 7fb859800640 1 -- start start 2024-09-10T21:06:14.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb859800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb838004800 0x7fb854151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:14.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb859800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb854152ba0 0x7fb8541535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:14.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb859800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb854153af0 0x7fb8541f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:14.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb859800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb85415f4d0 con 0x7fb854152ba0 2024-09-10T21:06:14.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb859800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb85415be00 con 0x7fb838004800 2024-09-10T21:06:14.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb859800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb85415f650 con 0x7fb854153af0 2024-09-10T21:06:14.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb852000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb854152ba0 0x7fb8541535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb852000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb854152ba0 0x7fb8541535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46916/0 (socket says 172.21.15.100:46916) 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb852000640 1 -- 172.21.15.100:0/2056627193 learned_addr learned my addr 172.21.15.100:0/2056627193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb852a00640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb838004800 0x7fb854151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb853400640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb854153af0 0x7fb8541f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb852000640 1 -- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb854153af0 msgr2=0x7fb8541f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.519+0000 7fb852000640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb854153af0 0x7fb8541f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb852000640 1 -- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb838004800 msgr2=0x7fb854151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb852000640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb838004800 0x7fb854151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb852000640 1 -- 172.21.15.100:0/2056627193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8540ad980 con 0x7fb854152ba0 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb852000640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb854152ba0 0x7fb8541535b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb84002b060 tx=0x7fb840001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb84aa00640 1 -- 172.21.15.100:0/2056627193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840032030 con 0x7fb854152ba0 2024-09-10T21:06:14.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb84aa00640 1 -- 172.21.15.100:0/2056627193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8400038e0 con 0x7fb854152ba0 2024-09-10T21:06:14.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8540adc60 con 0x7fb854152ba0 2024-09-10T21:06:14.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb84aa00640 1 -- 172.21.15.100:0/2056627193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840003d10 con 0x7fb854152ba0 2024-09-10T21:06:14.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.520+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8540ae220 con 0x7fb854152ba0 2024-09-10T21:06:14.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.521+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb854153f00 con 0x7fb854152ba0 2024-09-10T21:06:14.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.522+0000 7fb84aa00640 1 -- 172.21.15.100:0/2056627193 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb84002e440 con 0x7fb854152ba0 2024-09-10T21:06:14.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.523+0000 7fb84aa00640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb834077f70 0x7fb83407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:14.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.523+0000 7fb84aa00640 1 -- 172.21.15.100:0/2056627193 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb8400ba4f0 con 0x7fb854152ba0 2024-09-10T21:06:14.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.524+0000 7fb852a00640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb834077f70 0x7fb83407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:14.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.524+0000 7fb852a00640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb834077f70 0x7fb83407a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8540527e0 tx=0x7fb844009500 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:14.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.527+0000 7fb84aa00640 1 -- 172.21.15.100:0/2056627193 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb854153f00 con 0x7fb854152ba0 2024-09-10T21:06:14.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.710+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8540b1d80 con 0x7fb854152ba0 2024-09-10T21:06:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.711+0000 7fb84aa00640 1 -- 172.21.15.100:0/2056627193 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fb840047030 con 0x7fb854152ba0 2024-09-10T21:06:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:14.715 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.713+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb834077f70 msgr2=0x7fb83407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.713+0000 7fb859800640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb834077f70 0x7fb83407a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8540527e0 tx=0x7fb844009500 comp rx=0 tx=0).stop 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.713+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb854152ba0 msgr2=0x7fb8541535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.713+0000 7fb859800640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb854152ba0 0x7fb8541535b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb84002b060 tx=0x7fb840001c10 comp rx=0 tx=0).stop 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.714+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 shutdown_connections 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.714+0000 7fb859800640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb854153af0 0x7fb8541f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.714+0000 7fb859800640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb854152ba0 0x7fb8541535b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.714+0000 7fb859800640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb834077f70 0x7fb83407a430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.714+0000 7fb859800640 1 --2- 172.21.15.100:0/2056627193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb838004800 0x7fb854151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.714+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 >> 172.21.15.100:0/2056627193 conn(0x7fb85406cb50 msgr2=0x7fb8540cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.714+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 shutdown_connections 2024-09-10T21:06:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:14.714+0000 7fb859800640 1 -- 172.21.15.100:0/2056627193 wait complete. 2024-09-10T21:06:15.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T21:06:07.129552+0000', 'modified': '2024-09-10T21:06:12.166991+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4401}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4401': {'gid': 4401, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6837/2407425318', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6835', 'nonce': 2407425318}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 2407425318}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4401, 'qdb_cluster': [4401]} 2024-09-10T21:06:15.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T21:06:15.138 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T21:06:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.292+0000 7fc1bfe00640 1 -- 172.21.15.100:0/3210803388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b80741e0 msgr2=0x7fc1b815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.292+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/3210803388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b80741e0 0x7fc1b815f4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80cd2b0 tx=0x7fc1a402a5f0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.292+0000 7fc1bfe00640 1 -- 172.21.15.100:0/3210803388 shutdown_connections 2024-09-10T21:06:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.292+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/3210803388 >> v2:172.21.15.130:3300/0 conn(0x7fc1b815c750 0x7fc1b80cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.292+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/3210803388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b80741e0 0x7fc1b815f4d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.292+0000 7fc1bfe00640 1 -- 172.21.15.100:0/3210803388 >> 172.21.15.100:0/3210803388 conn(0x7fc1b806cb50 msgr2=0x7fc1b806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.292+0000 7fc1bfe00640 1 -- 172.21.15.100:0/3210803388 shutdown_connections 2024-09-10T21:06:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.292+0000 7fc1bfe00640 1 -- 172.21.15.100:0/3210803388 wait complete. 2024-09-10T21:06:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.294+0000 7fc1bfe00640 1 Processor -- start 2024-09-10T21:06:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.294+0000 7fc1bfe00640 1 -- start start 2024-09-10T21:06:15.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bfe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1b80741e0 0x7fc1b806e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1b815b680 0x7fc1b81f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b815c750 0x7fc1b80cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bfe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b80b2860 con 0x7fc1b815c750 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bfe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b80d00d0 con 0x7fc1b815b680 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bfe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b80b29e0 con 0x7fc1b80741e0 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b815c750 0x7fc1b80cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b815c750 0x7fc1b80cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46930/0 (socket says 172.21.15.100:46930) 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bde00640 1 -- 172.21.15.100:0/1967459609 learned_addr learned my addr 172.21.15.100:0/1967459609 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bca00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1b815b680 0x7fc1b81f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1b80741e0 0x7fc1b806e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bde00640 1 -- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1b80741e0 msgr2=0x7fc1b806e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bde00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1b80741e0 0x7fc1b806e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bde00640 1 -- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1b815b680 msgr2=0x7fc1b81f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bde00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1b815b680 0x7fc1b81f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bde00640 1 -- 172.21.15.100:0/1967459609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b81f5790 con 0x7fc1b815c750 2024-09-10T21:06:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.295+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1b80741e0 0x7fc1b806e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.296+0000 7fc1bde00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b815c750 0x7fc1b80cbb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000d660 tx=0x7fc1b000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.296+0000 7fc1b5600640 1 -- 172.21.15.100:0/1967459609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0017070 con 0x7fc1b815c750 2024-09-10T21:06:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.296+0000 7fc1b5600640 1 -- 172.21.15.100:0/1967459609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1b0005310 con 0x7fc1b815c750 2024-09-10T21:06:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.296+0000 7fc1b5600640 1 -- 172.21.15.100:0/1967459609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0009820 con 0x7fc1b815c750 2024-09-10T21:06:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.296+0000 7fc1bfe00640 1 -- 172.21.15.100:0/1967459609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b80cc070 con 0x7fc1b815c750 2024-09-10T21:06:15.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.296+0000 7fc1bfe00640 1 -- 172.21.15.100:0/1967459609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b80b1330 con 0x7fc1b815c750 2024-09-10T21:06:15.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.298+0000 7fc1b5600640 1 -- 172.21.15.100:0/1967459609 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc1b00099c0 con 0x7fc1b815c750 2024-09-10T21:06:15.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.299+0000 7fc1b5600640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc198077f70 0x7fc19807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.299+0000 7fc1b5600640 1 -- 172.21.15.100:0/1967459609 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc1b009a1f0 con 0x7fc1b815c750 2024-09-10T21:06:15.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1c2c88740 1 Processor -- start 2024-09-10T21:06:15.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc198077f70 0x7fc19807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1c2c88740 1 -- start start 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc198077f70 0x7fc19807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80b06b0 tx=0x7fc1ac009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a7a8b0 0x55cf51a7ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a35a20 0x55cf51a79390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cf519b8430 con 0x55cf51a35fa0 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cf519a85d0 con 0x55cf51a35a20 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.300+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55cf51997a00 con 0x55cf51a7a8b0 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a798d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46934/0 (socket says 172.21.15.100:46934) 2024-09-10T21:06:15.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 -- 172.21.15.100:0/195189368 learned_addr learned my addr 172.21.15.100:0/195189368 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bd400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a7a8b0 0x55cf51a7ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bca00640 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a35a20 0x55cf51a79390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 -- 172.21.15.100:0/195189368 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a7a8b0 msgr2=0x55cf51a7ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a7a8b0 0x55cf51a7ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 -- 172.21.15.100:0/195189368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a35a20 msgr2=0x55cf51a79390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a35a20 0x55cf51a79390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 -- 172.21.15.100:0/195189368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf51960520 con 0x55cf51a35fa0 2024-09-10T21:06:15.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bca00640 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a35a20 0x55cf51a79390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1bde00640 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a798d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0062230 tx=0x7fc1b005ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82a036a3be74662 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1a9c00640 1 -- 172.21.15.100:0/195189368 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0020070 con 0x55cf51a35fa0 2024-09-10T21:06:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1a9c00640 1 -- 172.21.15.100:0/195189368 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1b00622a0 con 0x55cf51a35fa0 2024-09-10T21:06:15.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.301+0000 7fc1a9c00640 1 -- 172.21.15.100:0/195189368 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0066d80 con 0x55cf51a35fa0 2024-09-10T21:06:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 -- 172.21.15.100:0/195189368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 msgr2=0x55cf51a798d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a798d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0062230 tx=0x7fc1b005ea20 comp rx=0 tx=0).stop 2024-09-10T21:06:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 -- 172.21.15.100:0/195189368 shutdown_connections 2024-09-10T21:06:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a798d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a35a20 0x55cf51a79390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/195189368 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a7a8b0 0x55cf51a7ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 -- 172.21.15.100:0/195189368 >> 172.21.15.100:0/195189368 conn(0x55cf51a30ff0 msgr2=0x55cf51a34a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 -- 172.21.15.100:0/195189368 shutdown_connections 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.302+0000 7fc1c2c88740 1 -- 172.21.15.100:0/195189368 wait complete. 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.303+0000 7fc1c2c88740 1 -- start start 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.303+0000 7fc1c2c88740 1 Processor -- start 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a8dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a893c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a8d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cf5193e330 con 0x55cf51a7a8b0 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cf5199b810 con 0x55cf51a792b0 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55cf51708620 con 0x55cf51a35fa0 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1c2c88740 10 client.0 _ll_register_callbacks cb 0x55cf51943420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:15.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1bca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a893c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1bca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a893c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46940/0 (socket says 172.21.15.100:46940) 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1bca00640 1 -- 172.21.15.100:0/1938846907 learned_addr learned my addr 172.21.15.100:0/1938846907 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1bde00640 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a8d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.304+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a8dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1bca00640 1 -- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 msgr2=0x55cf51a8dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1bca00640 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a8dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1bca00640 1 -- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 msgr2=0x55cf51a8d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1bca00640 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a8d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1bca00640 1 -- 172.21.15.100:0/1938846907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf516f9850 con 0x55cf51a7a8b0 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1bca00640 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a893c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40038a0 tx=0x7fc1a40038d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276283594bb12e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc19e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc19e000640 1 -- 172.21.15.100:0/1938846907 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4035030 con 0x55cf51a7a8b0 2024-09-10T21:06:15.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc19e000640 1 -- 172.21.15.100:0/1938846907 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc1a4044e00 con 0x55cf51a7a8b0 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1938846907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b00622a0 con 0x55cf51a7a8b0 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc19e000640 1 -- 172.21.15.100:0/1938846907 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fc1a4005d50 con 0x55cf51a7a8b0 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1c2c88740 10 client.4512 fetch_fsmap learned FSMap version 7 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.305+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1938846907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55cf517706b0 con 0x55cf51a7a8b0 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc19e000640 1 -- 172.21.15.100:0/1938846907 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1b00622a0 con 0x55cf51a7a8b0 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc19e000640 1 -- 172.21.15.100:0/1938846907 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7fc1a403b430 con 0x55cf51a7a8b0 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc1c2c88740 10 client.4512 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc1c2c88740 10 client.4512 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc1c2c88740 20 client.4512 populate_metadata read hostname 'smithi100' 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x55cf51a4a940 0x55cf51a979a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc1c2c88740 4 client.4512 mds_command: new command op to 4401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1938846907 --> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf519aa520 con 0x55cf51a4a940 2024-09-10T21:06:15.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.306+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x55cf51a4a940 0x55cf51a979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.307+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x55cf51a4a940 0x55cf51a979a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=405324fba3f6abc7 server_cookie=bd2b19ba3ca2aea4 in_seq=0 out_seq=0 2024-09-10T21:06:15.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.307+0000 7fc19e000640 10 client.4512 ms_handle_connect on v2:172.21.15.130:6835/2407425318 2024-09-10T21:06:15.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc19e000640 1 -- 172.21.15.100:0/1938846907 <== mds.0 v2:172.21.15.130:6835/2407425318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf519aa520 con 0x55cf51a4a940 2024-09-10T21:06:15.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc19e000640 10 client.4512 handle_command_reply: tid=0 2024-09-10T21:06:15.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 client.4512 shutdown 2024-09-10T21:06:15.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1938846907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 msgr2=0x55cf51a893c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a893c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40038a0 tx=0x7fc1a40038d0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1938846907 shutdown_connections 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x55cf51a4a940 0x55cf51a979a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a8d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a893c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1938846907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a8dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc19e000640 0 client.4512 ms_handle_reset on v2:172.21.15.130:6835/2407425318 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1938846907 >> 172.21.15.100:0/1938846907 conn(0x55cf51a35a20 msgr2=0x55cf51a2fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1938846907 shutdown_connections 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.308+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1938846907 wait complete. 2024-09-10T21:06:15.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.309+0000 7fc1c2c88740 20 client.4512 trim_cache size 0 max 16384 2024-09-10T21:06:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.327+0000 7fc1c2c88740 1 Processor -- start 2024-09-10T21:06:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.327+0000 7fc1c2c88740 1 -- start start 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.328+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a79ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.328+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.328+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a72800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.328+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b82013a0 con 0x55cf51a7a8b0 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.328+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b80ae4b0 con 0x55cf51a792b0 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.328+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b81f89e0 con 0x55cf51a35fa0 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a72800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a72800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46954/0 (socket says 172.21.15.100:46954) 2024-09-10T21:06:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 -- 172.21.15.100:0/1157322062 learned_addr learned my addr 172.21.15.100:0/1157322062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a79ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 -- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 msgr2=0x55cf51a79ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bca00640 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a79ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 -- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 msgr2=0x55cf51a722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 -- 172.21.15.100:0/1157322062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf51a2f830 con 0x55cf51a7a8b0 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bd400640 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a79ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bca00640 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1bde00640 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a72800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00983d0 tx=0x7fc1b009a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879dcd7873c464fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1a9200640 1 -- 172.21.15.100:0/1157322062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0020040 con 0x55cf51a7a8b0 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1a9200640 1 -- 172.21.15.100:0/1157322062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1b00629a0 con 0x55cf51a7a8b0 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.329+0000 7fc1a9200640 1 -- 172.21.15.100:0/1157322062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b006b7a0 con 0x55cf51a7a8b0 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1157322062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 msgr2=0x55cf51a72800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a72800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00983d0 tx=0x7fc1b009a040 comp rx=0 tx=0).stop 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1157322062 shutdown_connections 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a7a8b0 0x55cf51a72800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a792b0 0x55cf51a722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/1157322062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a35fa0 0x55cf51a79ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1157322062 >> 172.21.15.100:0/1157322062 conn(0x55cf51a35a20 msgr2=0x55cf51a32f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1157322062 shutdown_connections 2024-09-10T21:06:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.330+0000 7fc1c2c88740 1 -- 172.21.15.100:0/1157322062 wait complete. 2024-09-10T21:06:15.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.331+0000 7fc1c2c88740 1 -- start start 2024-09-10T21:06:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.331+0000 7fc1c2c88740 1 Processor -- start 2024-09-10T21:06:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a77840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a792b0 0x55cf51ae1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1c2c88740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a7a8b0 0x55cf51a32d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cf51a4a7c0 con 0x55cf51a35fa0 2024-09-10T21:06:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cf51a4b490 con 0x55cf51a7a8b0 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1c2c88740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55cf51a4ad50 con 0x55cf51a792b0 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1c2c88740 10 client.0 _ll_register_callbacks cb 0x7fc1a40044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a77840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a77840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46968/0 (socket says 172.21.15.100:46968) 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bd400640 1 -- 172.21.15.100:0/3785806687 learned_addr learned my addr 172.21.15.100:0/3785806687 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bca00640 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a792b0 0x55cf51ae1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bde00640 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a7a8b0 0x55cf51a32d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bd400640 1 -- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a792b0 msgr2=0x55cf51ae1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bd400640 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a792b0 0x55cf51ae1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bd400640 1 -- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a7a8b0 msgr2=0x55cf51a32d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bd400640 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a7a8b0 0x55cf51a32d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.332+0000 7fc1bd400640 1 -- 172.21.15.100:0/3785806687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf51a97ad0 con 0x55cf51a35fa0 2024-09-10T21:06:15.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1bd400640 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a77840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac003fd0 tx=0x7fc1ac000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47b66f3d15e6b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc19e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc19e000640 1 -- 172.21.15.100:0/3785806687 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac005420 con 0x55cf51a35fa0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc19e000640 1 -- 172.21.15.100:0/3785806687 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc1ac010040 con 0x55cf51a35fa0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 1 -- 172.21.15.100:0/3785806687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b00629a0 con 0x55cf51a35fa0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc19e000640 1 -- 172.21.15.100:0/3785806687 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fc1ac0055c0 con 0x55cf51a35fa0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 10 client.4518 fetch_fsmap learned FSMap version 7 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 1 -- 172.21.15.100:0/3785806687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55cf51afbc00 con 0x55cf51a35fa0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc19e000640 1 -- 172.21.15.100:0/3785806687 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1b00629a0 con 0x55cf51a35fa0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc19e000640 1 -- 172.21.15.100:0/3785806687 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7fc1ac033050 con 0x55cf51a35fa0 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 10 client.4518 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 10 client.4518 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 20 client.4518 populate_metadata read hostname 'smithi100' 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x55cf51aff800 0x55cf51a76600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 4 client.4518 mds_command: new command op to 4401 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.333+0000 7fc1c2c88740 1 -- 172.21.15.100:0/3785806687 --> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] -- command(tid 0: {"prefix": "status"}) -- 0x55cf519a5fd0 con 0x55cf51aff800 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.334+0000 7fc1bca00640 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x55cf51aff800 0x55cf51a76600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.334+0000 7fc1bca00640 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x55cf51aff800 0x55cf51a76600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55da35d1fa9f635d server_cookie=b4f216d62fad244d in_seq=0 out_seq=0 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.334+0000 7fc19e000640 10 client.4518 ms_handle_connect on v2:172.21.15.130:6835/2407425318 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc19e000640 1 -- 172.21.15.100:0/3785806687 <== mds.0 v2:172.21.15.130:6835/2407425318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55cf519a5fd0 con 0x55cf51aff800 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc19e000640 10 client.4518 handle_command_reply: tid=0 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 client.4518 shutdown 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 -- 172.21.15.100:0/3785806687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 msgr2=0x55cf51a77840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a77840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac003fd0 tx=0x7fc1ac000f40 comp rx=0 tx=0).stop 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 -- 172.21.15.100:0/3785806687 shutdown_connections 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x55cf51aff800 0x55cf51a76600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf51a7a8b0 0x55cf51a32d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55cf51a792b0 0x55cf51ae1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 --2- 172.21.15.100:0/3785806687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf51a35fa0 0x55cf51a77840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc19e000640 0 client.4518 ms_handle_reset on v2:172.21.15.130:6835/2407425318 2024-09-10T21:06:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 -- 172.21.15.100:0/3785806687 >> 172.21.15.100:0/3785806687 conn(0x55cf51a35a20 msgr2=0x55cf51a4f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 -- 172.21.15.100:0/3785806687 shutdown_connections 2024-09-10T21:06:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 1 -- 172.21.15.100:0/3785806687 wait complete. 2024-09-10T21:06:15.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.335+0000 7fc1c2c88740 20 client.4518 trim_cache size 0 max 16384 2024-09-10T21:06:15.343 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "65dcb08a-1e46-42c5-ba37-fc802a6ee031", 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4401, 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 7.629340064, 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 7, 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 27, 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 27, 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 13.640318579000001 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:06:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 -- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc198077f70 msgr2=0x7fc19807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc198077f70 0x7fc19807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80b06b0 tx=0x7fc1ac009040 comp rx=0 tx=0).stop 2024-09-10T21:06:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 -- 172.21.15.100:0/1967459609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b815c750 msgr2=0x7fc1b80cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b815c750 0x7fc1b80cbb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000d660 tx=0x7fc1b000db20 comp rx=0 tx=0).stop 2024-09-10T21:06:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 -- 172.21.15.100:0/1967459609 shutdown_connections 2024-09-10T21:06:15.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1b815c750 0x7fc1b80cbb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc198077f70 0x7fc19807a430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1b815b680 0x7fc1b81f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 --2- 172.21.15.100:0/1967459609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1b80741e0 0x7fc1b806e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 -- 172.21.15.100:0/1967459609 >> 172.21.15.100:0/1967459609 conn(0x7fc1b806cb50 msgr2=0x7fc1b815d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 -- 172.21.15.100:0/1967459609 shutdown_connections 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.336+0000 7fc1bfe00640 1 -- 172.21.15.100:0/1967459609 wait complete. 2024-09-10T21:06:15.354 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T21:06:15.354 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:15.355 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T21:06:15.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.506+0000 7f0265400640 1 -- 172.21.15.100:0/2918019443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 msgr2=0x7f026015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.506+0000 7f0265400640 1 --2- 172.21.15.100:0/2918019443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 0x7f026015ba60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0250005fd0 tx=0x7f025002a8b0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.506+0000 7f0265400640 1 -- 172.21.15.100:0/2918019443 shutdown_connections 2024-09-10T21:06:15.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.506+0000 7f0265400640 1 --2- 172.21.15.100:0/2918019443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 0x7f026015ba60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.506+0000 7f0265400640 1 -- 172.21.15.100:0/2918019443 >> 172.21.15.100:0/2918019443 conn(0x7f026006cb50 msgr2=0x7f026006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.506+0000 7f0265400640 1 -- 172.21.15.100:0/2918019443 shutdown_connections 2024-09-10T21:06:15.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.506+0000 7f0265400640 1 -- 172.21.15.100:0/2918019443 wait complete. 2024-09-10T21:06:15.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.508+0000 7f0265400640 1 Processor -- start 2024-09-10T21:06:15.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.508+0000 7f0265400640 1 -- start start 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f0265400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 0x7f0260154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f0265400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015b680 0x7f0260153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f0265400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c750 0x7f026006ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f0265400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02600b2bf0 con 0x7f02600741e0 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f0265400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02600b2a70 con 0x7f026015b680 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f0265400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f02600b2d70 con 0x7f026015c750 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 0x7f0260154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 0x7f0260154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46982/0 (socket says 172.21.15.100:46982) 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025e800640 1 -- 172.21.15.100:0/761377064 learned_addr learned my addr 172.21.15.100:0/761377064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025f200640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c750 0x7f026006ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025de00640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015b680 0x7f0260153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025e800640 1 -- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c750 msgr2=0x7f026006ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025e800640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c750 0x7f026006ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025e800640 1 -- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015b680 msgr2=0x7f0260153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025e800640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015b680 0x7f0260153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.509+0000 7f025e800640 1 -- 172.21.15.100:0/761377064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0260159dc0 con 0x7f02600741e0 2024-09-10T21:06:15.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.510+0000 7f025e800640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 0x7f0260154590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0250006010 tx=0x7f0250003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.510+0000 7f0256a00640 1 -- 172.21.15.100:0/761377064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250040070 con 0x7f02600741e0 2024-09-10T21:06:15.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.510+0000 7f0256a00640 1 -- 172.21.15.100:0/761377064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0250004540 con 0x7f02600741e0 2024-09-10T21:06:15.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.510+0000 7f0256a00640 1 -- 172.21.15.100:0/761377064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250003e10 con 0x7f02600741e0 2024-09-10T21:06:15.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.510+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026015a0a0 con 0x7f02600741e0 2024-09-10T21:06:15.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.510+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026015a660 con 0x7f02600741e0 2024-09-10T21:06:15.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.511+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026015f4d0 con 0x7f02600741e0 2024-09-10T21:06:15.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.512+0000 7f0256a00640 1 -- 172.21.15.100:0/761377064 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0250045460 con 0x7f02600741e0 2024-09-10T21:06:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.513+0000 7f0256a00640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.513+0000 7f0256a00640 1 -- 172.21.15.100:0/761377064 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f02500bbbb0 con 0x7f02600741e0 2024-09-10T21:06:15.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.514+0000 7f025de00640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.514+0000 7f025de00640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02600ce8e0 tx=0x7f024c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.517+0000 7f0256a00640 1 -- 172.21.15.100:0/761377064 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0250084400 con 0x7f02600741e0 2024-09-10T21:06:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.741+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0260157870 con 0x7f02600741e0 2024-09-10T21:06:15.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.741+0000 7f0256a00640 1 -- 172.21.15.100:0/761377064 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f0250083d00 con 0x7f02600741e0 2024-09-10T21:06:15.745 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T21:06:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.743+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 msgr2=0x7f024007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.743+0000 7f0265400640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02600ce8e0 tx=0x7f024c009040 comp rx=0 tx=0).stop 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.743+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 msgr2=0x7f0260154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.743+0000 7f0265400640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 0x7f0260154590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0250006010 tx=0x7f0250003c20 comp rx=0 tx=0).stop 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.744+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 shutdown_connections 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.744+0000 7f0265400640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c750 0x7f026006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.744+0000 7f0265400640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.744+0000 7f0265400640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015b680 0x7f0260153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.744+0000 7f0265400640 1 --2- 172.21.15.100:0/761377064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 0x7f0260154590 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.744+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 >> 172.21.15.100:0/761377064 conn(0x7f026006cb50 msgr2=0x7f02600cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.744+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 shutdown_connections 2024-09-10T21:06:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15.744+0000 7f0265400640 1 -- 172.21.15.100:0/761377064 wait complete. 2024-09-10T21:06:15.763 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T21:06:15.763 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:06:15.764 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-10T21:06:15.764 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-10T21:06:15.764 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:15.764 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T21:06:15.764 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:06:15.764 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:06:15.764 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T21:06:15.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:15.764 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-10T21:06:15.799 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:15.800 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:06:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T21:06:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42684sec preferred_lft 42684sec 2024-09-10T21:06:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-10T21:06:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:15.804 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T21:06:15.804 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:15.804 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:15.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-09-10T21:06:15.805 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-09-10T21:06:15.805 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-09-10T21:06:15.805 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T21:06:15.805 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:16.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:16.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:16.214 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:06:16.269 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T21:06:16.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:16.272 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-10T21:06:16.332 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-10T21:06:16.333 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:06:16.333 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T21:06:16.333 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T21:06:16.333 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:06:16.333 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:16.333 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:16.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T21:06:16.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T21:06:16.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T21:06:16.334 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:16.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:16.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:16.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:16.959 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T21:06:16.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:16.996 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-10T21:06:17.071 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:17.071 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:17.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T21:06:17.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-10T21:06:17.071 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:17.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:17.246 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-10T21:06:17.246 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:17.246 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:17.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-10T21:06:17.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T21:06:17.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-10T21:06:17.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-10T21:06:17.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-10T21:06:17.247 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:17.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:17.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:17.482 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:17.482 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:17.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-10T21:06:17.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T21:06:17.482 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:17.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:17.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:17.648 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-10T21:06:17.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:17.648 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:17.684 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T21:06:17.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:17.685 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:17.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:06:17.856 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:17.892 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:06:17.893 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:06:17.894 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:06:17.895 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:06:17.895 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:06:17.895 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:06:17.895 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T21:06:17.895 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:17.896 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:06:17.973 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T21:06:17.973 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-10T21:06:18.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:06:18.074 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:18.110 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:06:18.111 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:06:18.112 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:06:18.113 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:06:18.113 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:06:18.113 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T21:06:18.113 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T21:06:18.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:18.114 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:06:18.183 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:2024-09-10T21:06:18.180+0000 7f222be1b480 -1 init, newargv = 0x564db13ccfc0 newargc=15 2024-09-10T21:06:18.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[43153]: starting ceph client 2024-09-10T21:06:18.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[43153]: starting fuse 2024-09-10T21:06:19.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:06:19.357 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:19.394 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:06:19.395 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T21:06:19.397 INFO:teuthology.orchestra.run.smithi100.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:19.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:19.398 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:06:19.474 INFO:teuthology.orchestra.run.smithi100.stdout:42 2024-09-10T21:06:19.474 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-10T21:06:19.474 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:06:19.474 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-10T21:06:19.474 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-10T21:06:19.475 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.admin")) 2024-09-10T21:06:19.476 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-10T21:06:19.637 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.admin.43153.asok 2024-09-10T21:06:19.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:19.651 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43153.asok 2024-09-10T21:06:19.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:19.651 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43153.asok status 2024-09-10T21:06:19.839 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:06:19.839 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-09-10T21:06:19.839 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T21:06:19.839 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:06:19.839 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "admin", 2024-09-10T21:06:19.839 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-09-10T21:06:19.839 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-10T21:06:19.839 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "43153", 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4536, 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4536 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:06:19.840 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3234431591 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3234431591 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4536 192.168.0.1:0/3234431591", 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/3234431591", 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-09-10T21:06:19.841 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 7, 2024-09-10T21:06:19.842 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 27, 2024-09-10T21:06:19.842 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-09-10T21:06:19.842 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-09-10T21:06:19.842 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-09-10T21:06:19.842 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:06:19.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:19.850 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-09-10T21:06:19.850 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:19.889 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-09-10T21:06:19.889 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:19.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:19.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:19.986 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-10T21:06:20.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T21:06:20.097 INFO:teuthology.orchestra.run.smithi100.stdout:# file: . 2024-09-10T21:06:20.098 INFO:teuthology.orchestra.run.smithi100.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-10T21:06:20.098 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:20.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:20.106 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:06:20.106 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:20.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.335+0000 7fe1e8000640 1 -- 172.21.15.100:0/2903499935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e015b4d0 msgr2=0x7fe1e015ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.335+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2903499935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e015b4d0 0x7fe1e015ea60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4005fd0 tx=0x7fe1d402ab30 comp rx=0 tx=0).stop 2024-09-10T21:06:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.335+0000 7fe1e8000640 1 -- 172.21.15.100:0/2903499935 shutdown_connections 2024-09-10T21:06:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.335+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2903499935 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1e00cf810 0x7fe1e0161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.335+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2903499935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e015b4d0 0x7fe1e015ea60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.335+0000 7fe1e8000640 1 -- 172.21.15.100:0/2903499935 >> 172.21.15.100:0/2903499935 conn(0x7fe1e006cb50 msgr2=0x7fe1e006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:20.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.335+0000 7fe1e8000640 1 -- 172.21.15.100:0/2903499935 shutdown_connections 2024-09-10T21:06:20.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.335+0000 7fe1e8000640 1 -- 172.21.15.100:0/2903499935 wait complete. 2024-09-10T21:06:20.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.337+0000 7fe1e8000640 1 Processor -- start 2024-09-10T21:06:20.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.337+0000 7fe1e8000640 1 -- start start 2024-09-10T21:06:20.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e8000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e006eb60 0x7fe1e01f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:20.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e8000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1e00cf810 0x7fe1e01576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:20.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e8000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1e015b4d0 0x7fe1e00b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:20.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e8000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e006f380 con 0x7fe1e006eb60 2024-09-10T21:06:20.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e8000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e006f200 con 0x7fe1e00cf810 2024-09-10T21:06:20.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e8000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e01f88d0 con 0x7fe1e015b4d0 2024-09-10T21:06:20.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e006eb60 0x7fe1e01f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:20.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e006eb60 0x7fe1e01f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47004/0 (socket says 172.21.15.100:47004) 2024-09-10T21:06:20.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e5600640 1 -- 172.21.15.100:0/2792713420 learned_addr learned my addr 172.21.15.100:0/2792713420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:20.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e5600640 1 -- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1e015b4d0 msgr2=0x7fe1e00b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:20.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e4c00640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1e00cf810 0x7fe1e01576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:20.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e5600640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1e015b4d0 0x7fe1e00b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.338+0000 7fe1e5600640 1 -- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1e00cf810 msgr2=0x7fe1e01576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1e5600640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1e00cf810 0x7fe1e01576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1e5600640 1 -- 172.21.15.100:0/2792713420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e01f4850 con 0x7fe1e006eb60 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1e4c00640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1e00cf810 0x7fe1e01576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1e5600640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e006eb60 0x7fe1e01f8390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4000f80 tx=0x7fe1d402cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1dd600640 1 -- 172.21.15.100:0/2792713420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4044070 con 0x7fe1e006eb60 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1dd600640 1 -- 172.21.15.100:0/2792713420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1d4004250 con 0x7fe1e006eb60 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1dd600640 1 -- 172.21.15.100:0/2792713420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4004640 con 0x7fe1e006eb60 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e01f4b30 con 0x7fe1e006eb60 2024-09-10T21:06:20.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.339+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e01f50f0 con 0x7fe1e006eb60 2024-09-10T21:06:20.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.340+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e00b0370 con 0x7fe1e006eb60 2024-09-10T21:06:20.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.341+0000 7fe1dd600640 1 -- 172.21.15.100:0/2792713420 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe1d4036400 con 0x7fe1e006eb60 2024-09-10T21:06:20.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.342+0000 7fe1dd600640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe1c0077f70 0x7fe1c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:20.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.342+0000 7fe1dd600640 1 -- 172.21.15.100:0/2792713420 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe1d40baa20 con 0x7fe1e006eb60 2024-09-10T21:06:20.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.343+0000 7fe1e4c00640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe1c0077f70 0x7fe1c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:20.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.344+0000 7fe1e4c00640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe1c0077f70 0x7fe1c007a430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0154ac0 tx=0x7fe1cc005d90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:20.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.347+0000 7fe1dd600640 1 -- 172.21.15.100:0/2792713420 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe1d4032030 con 0x7fe1e006eb60 2024-09-10T21:06:20.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.541+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe1e00b3490 con 0x7fe1e006eb60 2024-09-10T21:06:20.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.542+0000 7fe1dd600640 1 -- 172.21.15.100:0/2792713420 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fe1d4083140 con 0x7fe1e006eb60 2024-09-10T21:06:20.545 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe1c0077f70 msgr2=0x7fe1c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe1c0077f70 0x7fe1c007a430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0154ac0 tx=0x7fe1cc005d90 comp rx=0 tx=0).stop 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e006eb60 msgr2=0x7fe1e01f8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e006eb60 0x7fe1e01f8390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4000f80 tx=0x7fe1d402cf00 comp rx=0 tx=0).stop 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 shutdown_connections 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1e015b4d0 0x7fe1e00b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe1c0077f70 0x7fe1c007a430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1e00cf810 0x7fe1e01576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 --2- 172.21.15.100:0/2792713420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1e006eb60 0x7fe1e01f8390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 >> 172.21.15.100:0/2792713420 conn(0x7fe1e006cb50 msgr2=0x7fe1e0161340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:20.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 shutdown_connections 2024-09-10T21:06:20.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.544+0000 7fe1e8000640 1 -- 172.21.15.100:0/2792713420 wait complete. 2024-09-10T21:06:20.563 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:06:20.563 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:20.599 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:20.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.793+0000 7fb7bae00640 1 -- 172.21.15.100:0/3710283989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7b415b460 msgr2=0x7fb7b40af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:20.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.793+0000 7fb7bae00640 1 --2- 172.21.15.100:0/3710283989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7b415b460 0x7fb7b40af480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009830 tx=0x7fb7a802a5c0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.793+0000 7fb7bae00640 1 -- 172.21.15.100:0/3710283989 shutdown_connections 2024-09-10T21:06:20.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.793+0000 7fb7bae00640 1 --2- 172.21.15.100:0/3710283989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7b415b460 0x7fb7b40af480 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.793+0000 7fb7bae00640 1 -- 172.21.15.100:0/3710283989 >> 172.21.15.100:0/3710283989 conn(0x7fb7b40b2200 msgr2=0x7fb7b40cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:20.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.793+0000 7fb7bae00640 1 -- 172.21.15.100:0/3710283989 shutdown_connections 2024-09-10T21:06:20.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.793+0000 7fb7bae00640 1 -- 172.21.15.100:0/3710283989 wait complete. 2024-09-10T21:06:20.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.795+0000 7fb7bae00640 1 Processor -- start 2024-09-10T21:06:20.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.795+0000 7fb7bae00640 1 -- start start 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7bae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b406fdc0 0x7fb7b40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7bae00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7b415b460 0x7fb7b41f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7bae00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7b415eba0 0x7fb7b4155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7bae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b40705c0 con 0x7fb7b406fdc0 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7bae00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b4070440 con 0x7fb7b415b460 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7bae00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b4070740 con 0x7fb7b415eba0 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b406fdc0 0x7fb7b40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b406fdc0 0x7fb7b40b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47014/0 (socket says 172.21.15.100:47014) 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9a00640 1 -- 172.21.15.100:0/1977825636 learned_addr learned my addr 172.21.15.100:0/1977825636 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9000640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7b415b460 0x7fb7b41f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7ba400640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7b415eba0 0x7fb7b4155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:20.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9a00640 1 -- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7b415eba0 msgr2=0x7fb7b4155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9a00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7b415eba0 0x7fb7b4155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9a00640 1 -- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7b415b460 msgr2=0x7fb7b41f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9a00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7b415b460 0x7fb7b41f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.796+0000 7fb7b9a00640 1 -- 172.21.15.100:0/1977825636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b40b5010 con 0x7fb7b406fdc0 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.797+0000 7fb7b9a00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b406fdc0 0x7fb7b40b3aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009950 tx=0x7fb7a8032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.797+0000 7fb7b1600640 1 -- 172.21.15.100:0/1977825636 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8040070 con 0x7fb7b406fdc0 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.797+0000 7fb7b1600640 1 -- 172.21.15.100:0/1977825636 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7a8005310 con 0x7fb7b406fdc0 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.797+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b40b3000 con 0x7fb7b406fdc0 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.797+0000 7fb7b1600640 1 -- 172.21.15.100:0/1977825636 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80047a0 con 0x7fb7b406fdc0 2024-09-10T21:06:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.797+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b40b4d30 con 0x7fb7b406fdc0 2024-09-10T21:06:20.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.798+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b40ce840 con 0x7fb7b406fdc0 2024-09-10T21:06:20.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.799+0000 7fb7b1600640 1 -- 172.21.15.100:0/1977825636 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb7a8004940 con 0x7fb7b406fdc0 2024-09-10T21:06:20.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.800+0000 7fb7b1600640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb794077fa0 0x7fb79407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:20.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.800+0000 7fb7b1600640 1 -- 172.21.15.100:0/1977825636 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb7a80bb410 con 0x7fb7b406fdc0 2024-09-10T21:06:20.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.800+0000 7fb7b9000640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb794077fa0 0x7fb79407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:20.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.801+0000 7fb7b9000640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb794077fa0 0x7fb79407a460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007fd0 tx=0x7fb7a0001370 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:20.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.804+0000 7fb7b1600640 1 -- 172.21.15.100:0/1977825636 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb7a8083bc0 con 0x7fb7b406fdc0 2024-09-10T21:06:21.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:20.999+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb7b4075630 con 0x7fb7b406fdc0 2024-09-10T21:06:21.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.000+0000 7fb7b1600640 1 -- 172.21.15.100:0/1977825636 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fb7a80834c0 con 0x7fb7b406fdc0 2024-09-10T21:06:21.003 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb794077fa0 msgr2=0x7fb79407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb794077fa0 0x7fb79407a460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007fd0 tx=0x7fb7a0001370 comp rx=0 tx=0).stop 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b406fdc0 msgr2=0x7fb7b40b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b406fdc0 0x7fb7b40b3aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009950 tx=0x7fb7a8032b90 comp rx=0 tx=0).stop 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 shutdown_connections 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7b415eba0 0x7fb7b4155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb794077fa0 0x7fb79407a460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7b415b460 0x7fb7b41f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 --2- 172.21.15.100:0/1977825636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b406fdc0 0x7fb7b40b3aa0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 >> 172.21.15.100:0/1977825636 conn(0x7fb7b40b2200 msgr2=0x7fb7b40729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 shutdown_connections 2024-09-10T21:06:21.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.002+0000 7fb7bae00640 1 -- 172.21.15.100:0/1977825636 wait complete. 2024-09-10T21:06:21.021 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-09-10T21:06:21.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:21.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-10T21:06:21.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[43153]: fuse finished with error 0 and tester_r 0 2024-09-10T21:06:21.078 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:06:21.166 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:06:21.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:21.167 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-10T21:06:21.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:21.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.403+0000 7fb8e6a00640 1 -- 172.21.15.100:0/3891332710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e006e0a0 msgr2=0x7fb8e00d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.403+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/3891332710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e006e0a0 0x7fb8e00d2090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005fd0 tx=0x7fb8cc02a540 comp rx=0 tx=0).stop 2024-09-10T21:06:21.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.403+0000 7fb8e6a00640 1 -- 172.21.15.100:0/3891332710 shutdown_connections 2024-09-10T21:06:21.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.403+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/3891332710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e00d25d0 0x7fb8e006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.403+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/3891332710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e006e0a0 0x7fb8e00d2090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.403+0000 7fb8e6a00640 1 -- 172.21.15.100:0/3891332710 >> 172.21.15.100:0/3891332710 conn(0x7fb8e00d3ab0 msgr2=0x7fb8e00d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.403+0000 7fb8e6a00640 1 -- 172.21.15.100:0/3891332710 shutdown_connections 2024-09-10T21:06:21.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.403+0000 7fb8e6a00640 1 -- 172.21.15.100:0/3891332710 wait complete. 2024-09-10T21:06:21.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.404+0000 7fb8e6a00640 1 Processor -- start 2024-09-10T21:06:21.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.405+0000 7fb8e6a00640 1 -- start start 2024-09-10T21:06:21.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.405+0000 7fb8e6a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006e0a0 0x7fb8e01f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.405+0000 7fb8e6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e0161140 0x7fb8e0155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.405+0000 7fb8e6a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e00cb570 0x7fb8e00c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e6a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e006e8f0 con 0x7fb8e0161140 2024-09-10T21:06:21.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e6a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e006e770 con 0x7fb8e00cb570 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e6a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e00b3030 con 0x7fb8e006e0a0 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e0161140 0x7fb8e0155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e0161140 0x7fb8e0155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47032/0 (socket says 172.21.15.100:47032) 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 -- 172.21.15.100:0/86668004 learned_addr learned my addr 172.21.15.100:0/86668004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e5600640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006e0a0 0x7fb8e01f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e6000640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e00cb570 0x7fb8e00c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 -- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006e0a0 msgr2=0x7fb8e01f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006e0a0 0x7fb8e01f8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 -- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e00cb570 msgr2=0x7fb8e00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e00cb570 0x7fb8e00c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 -- 172.21.15.100:0/86668004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e01f8770 con 0x7fb8e0161140 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.406+0000 7fb8e4c00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e0161140 0x7fb8e0155680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc000c00 tx=0x7fb8cc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.407+0000 7fb8dd600640 1 -- 172.21.15.100:0/86668004 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc03f070 con 0x7fb8e0161140 2024-09-10T21:06:21.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.407+0000 7fb8dd600640 1 -- 172.21.15.100:0/86668004 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8cc0047a0 con 0x7fb8e0161140 2024-09-10T21:06:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.407+0000 7fb8dd600640 1 -- 172.21.15.100:0/86668004 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc035030 con 0x7fb8e0161140 2024-09-10T21:06:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.407+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e0155bc0 con 0x7fb8e0161140 2024-09-10T21:06:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.407+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e00cbd10 con 0x7fb8e0161140 2024-09-10T21:06:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.408+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e006d760 con 0x7fb8e0161140 2024-09-10T21:06:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.409+0000 7fb8dd600640 1 -- 172.21.15.100:0/86668004 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb8cc004c10 con 0x7fb8e0161140 2024-09-10T21:06:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.410+0000 7fb8dd600640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb8c0077f70 0x7fb8c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.411+0000 7fb8dd600640 1 -- 172.21.15.100:0/86668004 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb8cc0bb570 con 0x7fb8e0161140 2024-09-10T21:06:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.411+0000 7fb8e5600640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb8c0077f70 0x7fb8c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.412+0000 7fb8e5600640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb8c0077f70 0x7fb8c007a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4001720 tx=0x7fb8d4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.415+0000 7fb8dd600640 1 -- 172.21.15.100:0/86668004 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb8e01f8770 con 0x7fb8e0161140 2024-09-10T21:06:21.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.600+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8e0160770 con 0x7fb8e0161140 2024-09-10T21:06:21.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.601+0000 7fb8dd600640 1 -- 172.21.15.100:0/86668004 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fb8cc0836d0 con 0x7fb8e0161140 2024-09-10T21:06:21.605 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:21.606 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:21.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb8c0077f70 msgr2=0x7fb8c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb8c0077f70 0x7fb8c007a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4001720 tx=0x7fb8d4009040 comp rx=0 tx=0).stop 2024-09-10T21:06:21.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e0161140 msgr2=0x7fb8e0155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e0161140 0x7fb8e0155680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc000c00 tx=0x7fb8cc003910 comp rx=0 tx=0).stop 2024-09-10T21:06:21.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 shutdown_connections 2024-09-10T21:06:21.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb8c0077f70 0x7fb8c007a430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e00cb570 0x7fb8e00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e0161140 0x7fb8e0155680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.603+0000 7fb8e6a00640 1 --2- 172.21.15.100:0/86668004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006e0a0 0x7fb8e01f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.604+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 >> 172.21.15.100:0/86668004 conn(0x7fb8e00d3ab0 msgr2=0x7fb8e00d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.604+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 shutdown_connections 2024-09-10T21:06:21.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.604+0000 7fb8e6a00640 1 -- 172.21.15.100:0/86668004 wait complete. 2024-09-10T21:06:21.623 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:21.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.776+0000 7fcd08a00640 1 -- 172.21.15.100:0/4239544217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 msgr2=0x7fcd040cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.776+0000 7fcd08a00640 1 --2- 172.21.15.100:0/4239544217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 0x7fcd040cf780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fccfc005fd0 tx=0x7fccfc02aa00 comp rx=0 tx=0).stop 2024-09-10T21:06:21.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.776+0000 7fcd08a00640 1 -- 172.21.15.100:0/4239544217 shutdown_connections 2024-09-10T21:06:21.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.776+0000 7fcd08a00640 1 --2- 172.21.15.100:0/4239544217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 0x7fcd040cf780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.776+0000 7fcd08a00640 1 --2- 172.21.15.100:0/4239544217 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd0415b680 0x7fcd0415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.776+0000 7fcd08a00640 1 -- 172.21.15.100:0/4239544217 >> 172.21.15.100:0/4239544217 conn(0x7fcd0406cb50 msgr2=0x7fcd0406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.776+0000 7fcd08a00640 1 -- 172.21.15.100:0/4239544217 shutdown_connections 2024-09-10T21:06:21.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.776+0000 7fcd08a00640 1 -- 172.21.15.100:0/4239544217 wait complete. 2024-09-10T21:06:21.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.778+0000 7fcd08a00640 1 Processor -- start 2024-09-10T21:06:21.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.778+0000 7fcd08a00640 1 -- start start 2024-09-10T21:06:21.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd08a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd040741e0 0x7fcd04154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd08a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd0415b680 0x7fcd04150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd08a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 0x7fcd041f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd08a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcd040b2860 con 0x7fcd0415c750 2024-09-10T21:06:21.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd08a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd040b29e0 con 0x7fcd0415b680 2024-09-10T21:06:21.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd08a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcd040b2b60 con 0x7fcd040741e0 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd02800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 0x7fcd041f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd02800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 0x7fcd041f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34770/0 (socket says 172.21.15.100:34770) 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd02800640 1 -- 172.21.15.100:0/1392551678 learned_addr learned my addr 172.21.15.100:0/1392551678 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd01e00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd040741e0 0x7fcd04154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.779+0000 7fcd01400640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd0415b680 0x7fcd04150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd02800640 1 -- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd040741e0 msgr2=0x7fcd04154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd02800640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd040741e0 0x7fcd04154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd02800640 1 -- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd0415b680 msgr2=0x7fcd04150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd02800640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd0415b680 0x7fcd04150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd02800640 1 -- 172.21.15.100:0/1392551678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd040b05c0 con 0x7fcd0415c750 2024-09-10T21:06:21.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd01400640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd0415b680 0x7fcd04150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:21.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd02800640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 0x7fcd041f5ab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fccfc006010 tx=0x7fccfc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fccfa000640 1 -- 172.21.15.100:0/1392551678 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc046070 con 0x7fcd0415c750 2024-09-10T21:06:21.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fccfa000640 1 -- 172.21.15.100:0/1392551678 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccfc004540 con 0x7fcd0415c750 2024-09-10T21:06:21.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fccfa000640 1 -- 172.21.15.100:0/1392551678 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc033070 con 0x7fcd0415c750 2024-09-10T21:06:21.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd040b08a0 con 0x7fcd0415c750 2024-09-10T21:06:21.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.780+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd04155350 con 0x7fcd0415c750 2024-09-10T21:06:21.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.782+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd040b3030 con 0x7fcd0415c750 2024-09-10T21:06:21.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.783+0000 7fccfa000640 1 -- 172.21.15.100:0/1392551678 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fccfc040030 con 0x7fcd0415c750 2024-09-10T21:06:21.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.784+0000 7fccfa000640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcce4077f70 0x7fcce407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.784+0000 7fccfa000640 1 -- 172.21.15.100:0/1392551678 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fccfc0bafe0 con 0x7fcd0415c750 2024-09-10T21:06:21.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.784+0000 7fcd01e00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcce4077f70 0x7fcce407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.785+0000 7fcd01e00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcce4077f70 0x7fcce407a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fccf4005fd0 tx=0x7fccf4005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.788+0000 7fccfa000640 1 -- 172.21.15.100:0/1392551678 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fccfc03e070 con 0x7fcd0415c750 2024-09-10T21:06:21.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.971+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd040cc490 con 0x7fcd0415c750 2024-09-10T21:06:21.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.972+0000 7fccfa000640 1 -- 172.21.15.100:0/1392551678 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fccfc083760 con 0x7fcd0415c750 2024-09-10T21:06:21.976 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:21.977 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcce4077f70 msgr2=0x7fcce407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcce4077f70 0x7fcce407a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fccf4005fd0 tx=0x7fccf4005850 comp rx=0 tx=0).stop 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 msgr2=0x7fcd041f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 0x7fcd041f5ab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fccfc006010 tx=0x7fccfc003f10 comp rx=0 tx=0).stop 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 shutdown_connections 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd0415c750 0x7fcd041f5ab0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcce4077f70 0x7fcce407a430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd0415b680 0x7fcd04150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 --2- 172.21.15.100:0/1392551678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd040741e0 0x7fcd04154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 >> 172.21.15.100:0/1392551678 conn(0x7fcd0406cb50 msgr2=0x7fcd0406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 shutdown_connections 2024-09-10T21:06:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:21.975+0000 7fcd08a00640 1 -- 172.21.15.100:0/1392551678 wait complete. 2024-09-10T21:06:21.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T21:06:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.152+0000 7ff0e2000640 1 -- 172.21.15.100:0/524390651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0c0004d40 msgr2=0x7ff0c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.152+0000 7ff0e2000640 1 --2- 172.21.15.100:0/524390651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0c0004d40 0x7ff0c00051c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc001e90 tx=0x7ff0c0005830 comp rx=0 tx=0).stop 2024-09-10T21:06:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.152+0000 7ff0dbe00640 1 -- 172.21.15.100:0/524390651 reap_dead start 2024-09-10T21:06:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.152+0000 7ff0e2000640 1 -- 172.21.15.100:0/524390651 shutdown_connections 2024-09-10T21:06:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.152+0000 7ff0e2000640 1 -- 172.21.15.100:0/524390651 >> 172.21.15.100:0/524390651 conn(0x7ff0dc06cb50 msgr2=0x7ff0dc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.152+0000 7ff0e2000640 1 -- 172.21.15.100:0/524390651 shutdown_connections 2024-09-10T21:06:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.152+0000 7ff0e2000640 1 -- 172.21.15.100:0/524390651 wait complete. 2024-09-10T21:06:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.154+0000 7ff0e2000640 1 Processor -- start 2024-09-10T21:06:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.154+0000 7ff0e2000640 1 -- start start 2024-09-10T21:06:22.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0e2000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0c0004d40 0x7ff0dc159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:22.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0e2000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0dc1f6060 0x7ff0dc1f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:22.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0e2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0dc145e70 0x7ff0dc1462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:22.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0e2000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc15bdf0 con 0x7ff0dc145e70 2024-09-10T21:06:22.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0e2000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc15bc70 con 0x7ff0c0004d40 2024-09-10T21:06:22.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0e2000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff0dc15ceb0 con 0x7ff0dc1f6060 2024-09-10T21:06:22.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0dc145e70 0x7ff0dc1462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0dc145e70 0x7ff0dc1462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34782/0 (socket says 172.21.15.100:34782) 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0dbe00640 1 -- 172.21.15.100:0/2108934253 learned_addr learned my addr 172.21.15.100:0/2108934253 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0daa00640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0dc1f6060 0x7ff0dc1f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0db400640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0c0004d40 0x7ff0dc159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0dbe00640 1 -- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0dc1f6060 msgr2=0x7ff0dc1f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0dbe00640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0dc1f6060 0x7ff0dc1f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0dbe00640 1 -- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0c0004d40 msgr2=0x7ff0dc159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0dbe00640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0c0004d40 0x7ff0dc159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.155+0000 7ff0dbe00640 1 -- 172.21.15.100:0/2108934253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc148bd0 con 0x7ff0dc145e70 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.156+0000 7ff0dbe00640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0dc145e70 0x7ff0dc1462d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc001fb0 tx=0x7ff0cc006610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.156+0000 7ff0d3400640 1 -- 172.21.15.100:0/2108934253 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc043070 con 0x7ff0dc145e70 2024-09-10T21:06:22.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.156+0000 7ff0d3400640 1 -- 172.21.15.100:0/2108934253 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0cc006780 con 0x7ff0dc145e70 2024-09-10T21:06:22.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.156+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc148e70 con 0x7ff0dc145e70 2024-09-10T21:06:22.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.156+0000 7ff0d3400640 1 -- 172.21.15.100:0/2108934253 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc001ae0 con 0x7ff0dc145e70 2024-09-10T21:06:22.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.156+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc149430 con 0x7ff0dc145e70 2024-09-10T21:06:22.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.157+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc15f4d0 con 0x7ff0dc145e70 2024-09-10T21:06:22.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.158+0000 7ff0d3400640 1 -- 172.21.15.100:0/2108934253 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff0cc003bd0 con 0x7ff0dc145e70 2024-09-10T21:06:22.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.159+0000 7ff0d3400640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff0b8077fa0 0x7ff0b807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:22.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.159+0000 7ff0d3400640 1 -- 172.21.15.100:0/2108934253 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff0cc0b9730 con 0x7ff0dc145e70 2024-09-10T21:06:22.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.159+0000 7ff0db400640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff0b8077fa0 0x7ff0b807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:22.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.160+0000 7ff0db400640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff0b8077fa0 0x7ff0b807a460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009c50 tx=0x7ff0d4005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:22.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.163+0000 7ff0d3400640 1 -- 172.21.15.100:0/2108934253 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff0cc081890 con 0x7ff0dc145e70 2024-09-10T21:06:22.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.380+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff0dc0cc490 con 0x7ff0dc145e70 2024-09-10T21:06:22.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.603+0000 7ff0d3400640 1 -- 172.21.15.100:0/2108934253 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7ff0cc0862c0 con 0x7ff0dc145e70 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff0b8077fa0 msgr2=0x7ff0b807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff0b8077fa0 0x7ff0b807a460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009c50 tx=0x7ff0d4005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0dc145e70 msgr2=0x7ff0dc1462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0dc145e70 0x7ff0dc1462d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc001fb0 tx=0x7ff0cc006610 comp rx=0 tx=0).stop 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 shutdown_connections 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0dc145e70 0x7ff0dc1462d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0dc1f6060 0x7ff0dc1f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff0b8077fa0 0x7ff0b807a460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 --2- 172.21.15.100:0/2108934253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0c0004d40 0x7ff0dc159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 >> 172.21.15.100:0/2108934253 conn(0x7ff0dc06cb50 msgr2=0x7ff0dc0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:22.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 shutdown_connections 2024-09-10T21:06:22.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.606+0000 7ff0e2000640 1 -- 172.21.15.100:0/2108934253 wait complete. 2024-09-10T21:06:22.625 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-10T21:06:22.625 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T21:06:22.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.783+0000 7f70fdc00640 1 -- 172.21.15.100:0/4180397719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f80d24d0 msgr2=0x7f70f80d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:22.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.783+0000 7f70fdc00640 1 --2- 172.21.15.100:0/4180397719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f80d24d0 0x7f70f80d01f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005fd0 tx=0x7f70e402a530 comp rx=0 tx=0).stop 2024-09-10T21:06:22.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.783+0000 7f70fdc00640 1 -- 172.21.15.100:0/4180397719 shutdown_connections 2024-09-10T21:06:22.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.783+0000 7f70fdc00640 1 --2- 172.21.15.100:0/4180397719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f80d24d0 0x7f70f80d01f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.783+0000 7f70fdc00640 1 --2- 172.21.15.100:0/4180397719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70f815db30 0x7f70f80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.783+0000 7f70fdc00640 1 -- 172.21.15.100:0/4180397719 >> 172.21.15.100:0/4180397719 conn(0x7f70f80d3a40 msgr2=0x7f70f80d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.783+0000 7f70fdc00640 1 -- 172.21.15.100:0/4180397719 shutdown_connections 2024-09-10T21:06:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.783+0000 7f70fdc00640 1 -- 172.21.15.100:0/4180397719 wait complete. 2024-09-10T21:06:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.785+0000 7f70fdc00640 1 Processor -- start 2024-09-10T21:06:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.785+0000 7f70fdc00640 1 -- start start 2024-09-10T21:06:22.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70fdc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70f80d4560 0x7f70f81f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:22.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70fdc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f815db30 0x7f70f80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:22.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70fdc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f815eae0 0x7f70f815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:22.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70fdc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70f80d08b0 con 0x7f70f815db30 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70fdc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70f80d0730 con 0x7f70f815eae0 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70fdc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f70f80d0a30 con 0x7f70f80d4560 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70f7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f815db30 0x7f70f80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70f7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f815db30 0x7f70f80cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34790/0 (socket says 172.21.15.100:34790) 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70f7400640 1 -- 172.21.15.100:0/742934190 learned_addr learned my addr 172.21.15.100:0/742934190 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70fd200640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f815eae0 0x7f70f815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.786+0000 7f70f7e00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70f80d4560 0x7f70f81f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70f7400640 1 -- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70f80d4560 msgr2=0x7f70f81f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70f7400640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70f80d4560 0x7f70f81f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70f7400640 1 -- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f815eae0 msgr2=0x7f70f815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70f7400640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f815eae0 0x7f70f815c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70f7400640 1 -- 172.21.15.100:0/742934190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f815cfb0 con 0x7f70f815db30 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70f7e00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70f80d4560 0x7f70f81f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:22.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70f7400640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f815db30 0x7f70f80cc910 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009850 tx=0x7f70e40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:22.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70efe00640 1 -- 172.21.15.100:0/742934190 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e403f070 con 0x7f70f815db30 2024-09-10T21:06:22.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70efe00640 1 -- 172.21.15.100:0/742934190 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70e4004890 con 0x7f70f815db30 2024-09-10T21:06:22.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f81f5870 con 0x7f70f815db30 2024-09-10T21:06:22.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70efe00640 1 -- 172.21.15.100:0/742934190 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4035030 con 0x7f70f815db30 2024-09-10T21:06:22.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.787+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81f4d90 con 0x7f70f815db30 2024-09-10T21:06:22.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.789+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f80b3c20 con 0x7f70f815db30 2024-09-10T21:06:22.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.789+0000 7f70efe00640 1 -- 172.21.15.100:0/742934190 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f70e4004c60 con 0x7f70f815db30 2024-09-10T21:06:22.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.790+0000 7f70efe00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70d8077fa0 0x7f70d807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:22.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.790+0000 7f70efe00640 1 -- 172.21.15.100:0/742934190 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f70e40bb2f0 con 0x7f70f815db30 2024-09-10T21:06:22.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.791+0000 7f70f7e00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70d8077fa0 0x7f70d807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:22.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.791+0000 7f70f7e00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70d8077fa0 0x7f70d807a460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70e800ab40 tx=0x7f70e800a520 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:22.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:22.794+0000 7f70efe00640 1 -- 172.21.15.100:0/742934190 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f70e40833c0 con 0x7f70f815db30 2024-09-10T21:06:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.010+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f70f80b99c0 con 0x7f70f815db30 2024-09-10T21:06:23.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.616+0000 7f70efe00640 1 -- 172.21.15.100:0/742934190 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f70e4087df0 con 0x7f70f815db30 2024-09-10T21:06:23.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70d8077fa0 msgr2=0x7f70d807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70d8077fa0 0x7f70d807a460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70e800ab40 tx=0x7f70e800a520 comp rx=0 tx=0).stop 2024-09-10T21:06:23.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f815db30 msgr2=0x7f70f80cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f815db30 0x7f70f80cc910 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009850 tx=0x7f70e40039e0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 shutdown_connections 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70d8077fa0 0x7f70d807a460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f815eae0 0x7f70f815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70f815db30 0x7f70f80cc910 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.619+0000 7f70fdc00640 1 --2- 172.21.15.100:0/742934190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70f80d4560 0x7f70f81f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.620+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 >> 172.21.15.100:0/742934190 conn(0x7f70f80d3a40 msgr2=0x7f70f80b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.620+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 shutdown_connections 2024-09-10T21:06:23.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.620+0000 7f70fdc00640 1 -- 172.21.15.100:0/742934190 wait complete. 2024-09-10T21:06:23.641 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T21:06:23.641 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:23.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.799+0000 7fc687200640 1 -- 172.21.15.100:0/2811394823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc664004800 msgr2=0x7fc664004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.799+0000 7fc687200640 1 --2- 172.21.15.100:0/2811394823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc664004800 0x7fc664004c80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009b50 tx=0x7fc664005830 comp rx=0 tx=0).stop 2024-09-10T21:06:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.799+0000 7fc687200640 1 -- 172.21.15.100:0/2811394823 shutdown_connections 2024-09-10T21:06:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.799+0000 7fc687200640 1 --2- 172.21.15.100:0/2811394823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc664004800 0x7fc664004c80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.799+0000 7fc687200640 1 -- 172.21.15.100:0/2811394823 >> 172.21.15.100:0/2811394823 conn(0x7fc68006cb50 msgr2=0x7fc68006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.799+0000 7fc687200640 1 -- 172.21.15.100:0/2811394823 shutdown_connections 2024-09-10T21:06:23.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.799+0000 7fc687200640 1 -- 172.21.15.100:0/2811394823 wait complete. 2024-09-10T21:06:23.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.800+0000 7fc687200640 1 Processor -- start 2024-09-10T21:06:23.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.801+0000 7fc687200640 1 -- start start 2024-09-10T21:06:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.801+0000 7fc687200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc664004800 0x7fc68014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.801+0000 7fc687200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6801541b0 0x7fc68015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.801+0000 7fc687200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc68015d810 0x7fc6801f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.801+0000 7fc687200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc68015f650 con 0x7fc6801541b0 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.801+0000 7fc687200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc68015f4d0 con 0x7fc664004800 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.801+0000 7fc687200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc68015f7d0 con 0x7fc68015d810 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6801541b0 0x7fc68015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6801541b0 0x7fc68015d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34806/0 (socket says 172.21.15.100:34806) 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 -- 172.21.15.100:0/1538207282 learned_addr learned my addr 172.21.15.100:0/1538207282 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67fe00640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc664004800 0x7fc68014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc685200640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc68015d810 0x7fc6801f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 -- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc68015d810 msgr2=0x7fc6801f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc68015d810 0x7fc6801f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 -- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc664004800 msgr2=0x7fc68014fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc664004800 0x7fc68014fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 -- 172.21.15.100:0/1538207282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc680150f30 con 0x7fc6801541b0 2024-09-10T21:06:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67fe00640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc664004800 0x7fc68014fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc685200640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc68015d810 0x7fc6801f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.802+0000 7fc67f400640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6801541b0 0x7fc68015d2d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc66c036040 tx=0x7fc66c0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.803+0000 7fc677e00640 1 -- 172.21.15.100:0/1538207282 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c038040 con 0x7fc6801541b0 2024-09-10T21:06:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.803+0000 7fc677e00640 1 -- 172.21.15.100:0/1538207282 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc66c041070 con 0x7fc6801541b0 2024-09-10T21:06:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.803+0000 7fc677e00640 1 -- 172.21.15.100:0/1538207282 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c03c430 con 0x7fc6801541b0 2024-09-10T21:06:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.803+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6801f3200 con 0x7fc6801541b0 2024-09-10T21:06:23.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.803+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68014f2e0 con 0x7fc6801541b0 2024-09-10T21:06:23.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.804+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6800cf860 con 0x7fc6801541b0 2024-09-10T21:06:23.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.805+0000 7fc677e00640 1 -- 172.21.15.100:0/1538207282 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc66c03b070 con 0x7fc6801541b0 2024-09-10T21:06:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.806+0000 7fc677e00640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc660077f70 0x7fc66007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.807+0000 7fc677e00640 1 -- 172.21.15.100:0/1538207282 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc66c0ba750 con 0x7fc6801541b0 2024-09-10T21:06:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.807+0000 7fc67fe00640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc660077f70 0x7fc66007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.808+0000 7fc67fe00640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc660077f70 0x7fc66007a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6800527e0 tx=0x7fc670006b10 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:23.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:23.811+0000 7fc677e00640 1 -- 172.21.15.100:0/1538207282 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc66c082e70 con 0x7fc6801541b0 2024-09-10T21:06:24.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.026+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6800cc490 con 0x7fc6801541b0 2024-09-10T21:06:24.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.026+0000 7fc677e00640 1 -- 172.21.15.100:0/1538207282 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fc66c082770 con 0x7fc6801541b0 2024-09-10T21:06:24.031 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:24.031 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-10T21:06:23:611303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:23.012445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:24.032 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-10T21:06:24.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc660077f70 msgr2=0x7fc66007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc660077f70 0x7fc66007a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6800527e0 tx=0x7fc670006b10 comp rx=0 tx=0).stop 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6801541b0 msgr2=0x7fc68015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6801541b0 0x7fc68015d2d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc66c036040 tx=0x7fc66c0336f0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 shutdown_connections 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc68015d810 0x7fc6801f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6801541b0 0x7fc68015d2d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc660077f70 0x7fc66007a430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 --2- 172.21.15.100:0/1538207282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc664004800 0x7fc68014fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 >> 172.21.15.100:0/1538207282 conn(0x7fc68006cb50 msgr2=0x7fc68015e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 shutdown_connections 2024-09-10T21:06:24.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.029+0000 7fc687200640 1 -- 172.21.15.100:0/1538207282 wait complete. 2024-09-10T21:06:24.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:24.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.200+0000 7f70b5000640 1 -- 172.21.15.100:0/3201742632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b00741e0 msgr2=0x7f70b015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.200+0000 7f70b5000640 1 --2- 172.21.15.100:0/3201742632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b00741e0 0x7f70b015f4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f709c005fd0 tx=0x7f709c02a5d0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.200+0000 7f70b5000640 1 -- 172.21.15.100:0/3201742632 shutdown_connections 2024-09-10T21:06:24.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.200+0000 7f70b5000640 1 --2- 172.21.15.100:0/3201742632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b00741e0 0x7f70b015f4d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.200+0000 7f70b5000640 1 --2- 172.21.15.100:0/3201742632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70b015b680 0x7f70b015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.200+0000 7f70b5000640 1 -- 172.21.15.100:0/3201742632 >> 172.21.15.100:0/3201742632 conn(0x7f70b006cb50 msgr2=0x7f70b006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:24.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.200+0000 7f70b5000640 1 -- 172.21.15.100:0/3201742632 shutdown_connections 2024-09-10T21:06:24.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.200+0000 7f70b5000640 1 -- 172.21.15.100:0/3201742632 wait complete. 2024-09-10T21:06:24.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.202+0000 7f70b5000640 1 Processor -- start 2024-09-10T21:06:24.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.202+0000 7f70b5000640 1 -- start start 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70b5000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70b00741e0 0x7f70b01f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70b5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b015b680 0x7f70b00ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70b5000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b015c750 0x7f70b01f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70b5000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70b00b29e0 con 0x7f70b015b680 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70b5000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70b00b2860 con 0x7f70b015c750 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70b5000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f70b00b2b60 con 0x7f70b00741e0 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70ad400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b015b680 0x7f70b00ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70ad400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b015b680 0x7f70b00ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34812/0 (socket says 172.21.15.100:34812) 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70ad400640 1 -- 172.21.15.100:0/3134164762 learned_addr learned my addr 172.21.15.100:0/3134164762 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70ade00640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70b00741e0 0x7f70b01f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70ae800640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b015c750 0x7f70b01f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70ad400640 1 -- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70b00741e0 msgr2=0x7f70b01f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70ad400640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70b00741e0 0x7f70b01f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.203+0000 7f70ad400640 1 -- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b015c750 msgr2=0x7f70b01f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.204+0000 7f70ad400640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b015c750 0x7f70b01f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.204+0000 7f70ad400640 1 -- 172.21.15.100:0/3134164762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b01f8130 con 0x7f70b015b680 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.204+0000 7f70ad400640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b015b680 0x7f70b00ae0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f709c000c00 tx=0x7f709c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.204+0000 7f70a6000640 1 -- 172.21.15.100:0/3134164762 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c03f070 con 0x7f70b015b680 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.204+0000 7f70a6000640 1 -- 172.21.15.100:0/3134164762 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f709c005600 con 0x7f70b015b680 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.204+0000 7f70a6000640 1 -- 172.21.15.100:0/3134164762 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c035030 con 0x7f70b015b680 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.204+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b01f8410 con 0x7f70b015b680 2024-09-10T21:06:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.204+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b00ad8f0 con 0x7f70b015b680 2024-09-10T21:06:24.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.205+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b00b3010 con 0x7f70b015b680 2024-09-10T21:06:24.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.206+0000 7f70a6000640 1 -- 172.21.15.100:0/3134164762 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f709c004a00 con 0x7f70b015b680 2024-09-10T21:06:24.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.207+0000 7f70a6000640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7090077f70 0x7f709007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.207+0000 7f70a6000640 1 -- 172.21.15.100:0/3134164762 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f709c0bae00 con 0x7f70b015b680 2024-09-10T21:06:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.208+0000 7f70ade00640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7090077f70 0x7f709007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:24.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.208+0000 7f70ade00640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7090077f70 0x7f709007a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70a0005fd0 tx=0x7f70a0009500 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:24.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.211+0000 7f70a6000640 1 -- 172.21.15.100:0/3134164762 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f709c083000 con 0x7f70b015b680 2024-09-10T21:06:24.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.399+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70b00cc490 con 0x7f70b015b680 2024-09-10T21:06:24.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.400+0000 7f70a6000640 1 -- 172.21.15.100:0/3134164762 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f709c087a30 con 0x7f70b015b680 2024-09-10T21:06:24.405 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:24.405 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7090077f70 msgr2=0x7f709007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7090077f70 0x7f709007a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70a0005fd0 tx=0x7f70a0009500 comp rx=0 tx=0).stop 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b015b680 msgr2=0x7f70b00ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b015b680 0x7f70b00ae0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f709c000c00 tx=0x7f709c003820 comp rx=0 tx=0).stop 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 shutdown_connections 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7090077f70 0x7f709007a430 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70b015c750 0x7f70b01f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70b015b680 0x7f70b00ae0f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 --2- 172.21.15.100:0/3134164762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70b00741e0 0x7f70b01f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 >> 172.21.15.100:0/3134164762 conn(0x7f70b006cb50 msgr2=0x7f70b00b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:24.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 shutdown_connections 2024-09-10T21:06:24.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.403+0000 7f70b5000640 1 -- 172.21.15.100:0/3134164762 wait complete. 2024-09-10T21:06:24.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T21:06:24.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:06:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 -- 172.21.15.100:0/3983039771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 msgr2=0x7f63f8073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 --2- 172.21.15.100:0/3983039771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 0x7f63f8073610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63f8152dc0 tx=0x7f63e802a560 comp rx=0 tx=0).stop 2024-09-10T21:06:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 -- 172.21.15.100:0/3983039771 shutdown_connections 2024-09-10T21:06:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 --2- 172.21.15.100:0/3983039771 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63f815c210 0x7f63f815f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 --2- 172.21.15.100:0/3983039771 >> v2:172.21.15.130:3300/0 conn(0x7f63f80cec80 0x7f63f815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 --2- 172.21.15.100:0/3983039771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 0x7f63f8073610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 -- 172.21.15.100:0/3983039771 >> 172.21.15.100:0/3983039771 conn(0x7f63f806d500 msgr2=0x7f63f80b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 -- 172.21.15.100:0/3983039771 shutdown_connections 2024-09-10T21:06:24.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.576+0000 7f63f7200640 1 -- 172.21.15.100:0/3983039771 wait complete. 2024-09-10T21:06:24.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.577+0000 7f63f7200640 1 Processor -- start 2024-09-10T21:06:24.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.578+0000 7f63f7200640 1 -- start start 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.578+0000 7f63f7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 0x7f63f8156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.578+0000 7f63f7200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63f80cec80 0x7f63f814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f7200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63f815c210 0x7f63f80b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63f815ffb0 con 0x7f63f80aea30 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f7200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f63f815fe30 con 0x7f63f815c210 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f7200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f63f8160130 con 0x7f63f80cec80 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 0x7f63f8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 0x7f63f8156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34838/0 (socket says 172.21.15.100:34838) 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 -- 172.21.15.100:0/365990959 learned_addr learned my addr 172.21.15.100:0/365990959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:24.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f6800640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63f815c210 0x7f63f80b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:24.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5400640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63f80cec80 0x7f63f814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:24.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 -- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63f80cec80 msgr2=0x7f63f814b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63f80cec80 0x7f63f814b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 -- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63f815c210 msgr2=0x7f63f80b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63f815c210 0x7f63f80b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 -- 172.21.15.100:0/365990959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f81525d0 con 0x7f63f80aea30 2024-09-10T21:06:24.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.579+0000 7f63f5e00640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 0x7f63f8156390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009850 tx=0x7f63e80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.580+0000 7f63ee000640 1 -- 172.21.15.100:0/365990959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e803f070 con 0x7f63f80aea30 2024-09-10T21:06:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.580+0000 7f63ee000640 1 -- 172.21.15.100:0/365990959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63e80047a0 con 0x7f63f80aea30 2024-09-10T21:06:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.580+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f8155f40 con 0x7f63f80aea30 2024-09-10T21:06:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.580+0000 7f63ee000640 1 -- 172.21.15.100:0/365990959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8035030 con 0x7f63f80aea30 2024-09-10T21:06:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.580+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f80b1620 con 0x7f63f80aea30 2024-09-10T21:06:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.581+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f815bcd0 con 0x7f63f80aea30 2024-09-10T21:06:24.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.582+0000 7f63ee000640 1 -- 172.21.15.100:0/365990959 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f63e8004bb0 con 0x7f63f80aea30 2024-09-10T21:06:24.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.583+0000 7f63ee000640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f63d8077fa0 0x7f63d807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:24.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.583+0000 7f63ee000640 1 -- 172.21.15.100:0/365990959 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f63e80bb020 con 0x7f63f80aea30 2024-09-10T21:06:24.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.583+0000 7f63f5400640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f63d8077fa0 0x7f63d807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:24.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.584+0000 7f63f5400640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f63d8077fa0 0x7f63d807a460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63f8152a60 tx=0x7f63e4005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:24.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.587+0000 7f63ee000640 1 -- 172.21.15.100:0/365990959 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f63f81525d0 con 0x7f63f80aea30 2024-09-10T21:06:24.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.772+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63f80b54e0 con 0x7f63d8077fa0 2024-09-10T21:06:24.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.779+0000 7f63ee000640 1 -- 172.21.15.100:0/365990959 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332543 (secure 0 0 0) 0x7f63f80b54e0 con 0x7f63d8077fa0 2024-09-10T21:06:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:24.790 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:06:24.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f63d8077fa0 msgr2=0x7f63d807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f63d8077fa0 0x7f63d807a460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63f8152a60 tx=0x7f63e4005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:24.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 msgr2=0x7f63f8156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:24.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 0x7f63f8156390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009850 tx=0x7f63e80038a0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 shutdown_connections 2024-09-10T21:06:24.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f63d8077fa0 0x7f63d807a460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63f815c210 0x7f63f80b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63f80cec80 0x7f63f814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 --2- 172.21.15.100:0/365990959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63f80aea30 0x7f63f8156390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:24.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 >> 172.21.15.100:0/365990959 conn(0x7f63f806d500 msgr2=0x7f63f80cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:24.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 shutdown_connections 2024-09-10T21:06:24.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.784+0000 7f63f7200640 1 -- 172.21.15.100:0/365990959 wait complete. 2024-09-10T21:06:24.804 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-10T21:06:24.690716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":148,"num_write_kb":1645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219660,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755060,"statfs":{"total":773094113280,"available":772869181440,"internally_reserved":0,"allocated":3514368,"data_stored":2072614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.937861"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106808+0000","last_change":"2024-09-10T21:06:06.737219+0000","last_active":"2024-09-10T21:06:13.106808+0000","last_peered":"2024-09-10T21:06:13.106808+0000","last_clean":"2024-09-10T21:06:13.106808+0000","last_became_active":"2024-09-10T21:06:06.736940+0000","last_became_peered":"2024-09-10T21:06:06.736940+0000","last_unstale":"2024-09-10T21:06:13.106808+0000","last_undegraded":"2024-09-10T21:06:13.106808+0000","last_fullsized":"2024-09-10T21:06:13.106808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096347+0000","last_change":"2024-09-10T21:06:07.729261+0000","last_active":"2024-09-10T21:06:13.096347+0000","last_peered":"2024-09-10T21:06:13.096347+0000","last_clean":"2024-09-10T21:06:13.096347+0000","last_became_active":"2024-09-10T21:06:07.728483+0000","last_became_peered":"2024-09-10T21:06:07.728483+0000","last_unstale":"2024-09-10T21:06:13.096347+0000","last_undegraded":"2024-09-10T21:06:13.096347+0000","last_fullsized":"2024-09-10T21:06:13.096347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:20.894078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754483+0000","last_change":"2024-09-10T21:06:11.772637+0000","last_active":"2024-09-10T21:06:12.754483+0000","last_peered":"2024-09-10T21:06:12.754483+0000","last_clean":"2024-09-10T21:06:12.754483+0000","last_became_active":"2024-09-10T21:06:11.771448+0000","last_became_peered":"2024-09-10T21:06:11.771448+0000","last_unstale":"2024-09-10T21:06:12.754483+0000","last_undegraded":"2024-09-10T21:06:12.754483+0000","last_fullsized":"2024-09-10T21:06:12.754483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:42.328984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096457+0000","last_change":"2024-09-10T21:06:06.732030+0000","last_active":"2024-09-10T21:06:13.096457+0000","last_peered":"2024-09-10T21:06:13.096457+0000","last_clean":"2024-09-10T21:06:13.096457+0000","last_became_active":"2024-09-10T21:06:06.731060+0000","last_became_peered":"2024-09-10T21:06:06.731060+0000","last_unstale":"2024-09-10T21:06:13.096457+0000","last_undegraded":"2024-09-10T21:06:13.096457+0000","last_fullsized":"2024-09-10T21:06:13.096457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:58.950962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096699+0000","last_change":"2024-09-10T21:06:07.738136+0000","last_active":"2024-09-10T21:06:13.096699+0000","last_peered":"2024-09-10T21:06:13.096699+0000","last_clean":"2024-09-10T21:06:13.096699+0000","last_became_active":"2024-09-10T21:06:07.737068+0000","last_became_peered":"2024-09-10T21:06:07.737068+0000","last_unstale":"2024-09-10T21:06:13.096699+0000","last_undegraded":"2024-09-10T21:06:13.096699+0000","last_fullsized":"2024-09-10T21:06:13.096699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:21.806911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105233+0000","last_change":"2024-09-10T21:06:11.779585+0000","last_active":"2024-09-10T21:06:13.105233+0000","last_peered":"2024-09-10T21:06:13.105233+0000","last_clean":"2024-09-10T21:06:13.105233+0000","last_became_active":"2024-09-10T21:06:11.779111+0000","last_became_peered":"2024-09-10T21:06:11.779111+0000","last_unstale":"2024-09-10T21:06:13.105233+0000","last_undegraded":"2024-09-10T21:06:13.105233+0000","last_fullsized":"2024-09-10T21:06:13.105233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:55.529656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751770+0000","last_change":"2024-09-10T21:06:06.730043+0000","last_active":"2024-09-10T21:06:12.751770+0000","last_peered":"2024-09-10T21:06:12.751770+0000","last_clean":"2024-09-10T21:06:12.751770+0000","last_became_active":"2024-09-10T21:06:06.729736+0000","last_became_peered":"2024-09-10T21:06:06.729736+0000","last_unstale":"2024-09-10T21:06:12.751770+0000","last_undegraded":"2024-09-10T21:06:12.751770+0000","last_fullsized":"2024-09-10T21:06:12.751770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:03.085613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754713+0000","last_change":"2024-09-10T21:06:07.749059+0000","last_active":"2024-09-10T21:06:12.754713+0000","last_peered":"2024-09-10T21:06:12.754713+0000","last_clean":"2024-09-10T21:06:12.754713+0000","last_became_active":"2024-09-10T21:06:07.748645+0000","last_became_peered":"2024-09-10T21:06:07.748645+0000","last_unstale":"2024-09-10T21:06:12.754713+0000","last_undegraded":"2024-09-10T21:06:12.754713+0000","last_fullsized":"2024-09-10T21:06:12.754713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:43.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106613+0000","last_change":"2024-09-10T21:06:11.774923+0000","last_active":"2024-09-10T21:06:13.106613+0000","last_peered":"2024-09-10T21:06:13.106613+0000","last_clean":"2024-09-10T21:06:13.106613+0000","last_became_active":"2024-09-10T21:06:11.774581+0000","last_became_peered":"2024-09-10T21:06:11.774581+0000","last_unstale":"2024-09-10T21:06:13.106613+0000","last_undegraded":"2024-09-10T21:06:13.106613+0000","last_fullsized":"2024-09-10T21:06:13.106613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:43.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751739+0000","last_change":"2024-09-10T21:06:06.725866+0000","last_active":"2024-09-10T21:06:12.751739+0000","last_peered":"2024-09-10T21:06:12.751739+0000","last_clean":"2024-09-10T21:06:12.751739+0000","last_became_active":"2024-09-10T21:06:06.725590+0000","last_became_peered":"2024-09-10T21:06:06.725590+0000","last_unstale":"2024-09-10T21:06:12.751739+0000","last_undegraded":"2024-09-10T21:06:12.751739+0000","last_fullsized":"2024-09-10T21:06:12.751739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106462+0000","last_change":"2024-09-10T21:06:07.748653+0000","last_active":"2024-09-10T21:06:13.106462+0000","last_peered":"2024-09-10T21:06:13.106462+0000","last_clean":"2024-09-10T21:06:13.106462+0000","last_became_active":"2024-09-10T21:06:07.748366+0000","last_became_peered":"2024-09-10T21:06:07.748366+0000","last_unstale":"2024-09-10T21:06:13.106462+0000","last_undegraded":"2024-09-10T21:06:13.106462+0000","last_fullsized":"2024-09-10T21:06:13.106462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:19.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105881+0000","last_change":"2024-09-10T21:06:11.768824+0000","last_active":"2024-09-10T21:06:13.105881+0000","last_peered":"2024-09-10T21:06:13.105881+0000","last_clean":"2024-09-10T21:06:13.105881+0000","last_became_active":"2024-09-10T21:06:11.768442+0000","last_became_peered":"2024-09-10T21:06:11.768442+0000","last_unstale":"2024-09-10T21:06:13.105881+0000","last_undegraded":"2024-09-10T21:06:13.105881+0000","last_fullsized":"2024-09-10T21:06:13.105881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:05.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105671+0000","last_change":"2024-09-10T21:06:07.733906+0000","last_active":"2024-09-10T21:06:13.105671+0000","last_peered":"2024-09-10T21:06:13.105671+0000","last_clean":"2024-09-10T21:06:13.105671+0000","last_became_active":"2024-09-10T21:06:07.733681+0000","last_became_peered":"2024-09-10T21:06:07.733681+0000","last_unstale":"2024-09-10T21:06:13.105671+0000","last_undegraded":"2024-09-10T21:06:13.105671+0000","last_fullsized":"2024-09-10T21:06:13.105671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:17.153627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106032+0000","last_change":"2024-09-10T21:06:06.732743+0000","last_active":"2024-09-10T21:06:13.106032+0000","last_peered":"2024-09-10T21:06:13.106032+0000","last_clean":"2024-09-10T21:06:13.106032+0000","last_became_active":"2024-09-10T21:06:06.732494+0000","last_became_peered":"2024-09-10T21:06:06.732494+0000","last_unstale":"2024-09-10T21:06:13.106032+0000","last_undegraded":"2024-09-10T21:06:13.106032+0000","last_fullsized":"2024-09-10T21:06:13.106032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:03.085613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107067+0000","last_change":"2024-09-10T21:06:11.777327+0000","last_active":"2024-09-10T21:06:13.107067+0000","last_peered":"2024-09-10T21:06:13.107067+0000","last_clean":"2024-09-10T21:06:13.107067+0000","last_became_active":"2024-09-10T21:06:11.771004+0000","last_became_peered":"2024-09-10T21:06:11.771004+0000","last_unstale":"2024-09-10T21:06:13.107067+0000","last_undegraded":"2024-09-10T21:06:13.107067+0000","last_fullsized":"2024-09-10T21:06:13.107067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:35.265715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755166+0000","last_change":"2024-09-10T21:06:07.734707+0000","last_active":"2024-09-10T21:06:12.755166+0000","last_peered":"2024-09-10T21:06:12.755166+0000","last_clean":"2024-09-10T21:06:12.755166+0000","last_became_active":"2024-09-10T21:06:07.733049+0000","last_became_peered":"2024-09-10T21:06:07.733049+0000","last_unstale":"2024-09-10T21:06:12.755166+0000","last_undegraded":"2024-09-10T21:06:12.755166+0000","last_fullsized":"2024-09-10T21:06:12.755166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106234+0000","last_change":"2024-09-10T21:06:06.720924+0000","last_active":"2024-09-10T21:06:13.106234+0000","last_peered":"2024-09-10T21:06:13.106234+0000","last_clean":"2024-09-10T21:06:13.106234+0000","last_became_active":"2024-09-10T21:06:06.719357+0000","last_became_peered":"2024-09-10T21:06:06.719357+0000","last_unstale":"2024-09-10T21:06:13.106234+0000","last_undegraded":"2024-09-10T21:06:13.106234+0000","last_fullsized":"2024-09-10T21:06:13.106234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:17.674783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751373+0000","last_change":"2024-09-10T21:06:11.771235+0000","last_active":"2024-09-10T21:06:12.751373+0000","last_peered":"2024-09-10T21:06:12.751373+0000","last_clean":"2024-09-10T21:06:12.751373+0000","last_became_active":"2024-09-10T21:06:11.770880+0000","last_became_peered":"2024-09-10T21:06:11.770880+0000","last_unstale":"2024-09-10T21:06:12.751373+0000","last_undegraded":"2024-09-10T21:06:12.751373+0000","last_fullsized":"2024-09-10T21:06:12.751373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:41.810392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105840+0000","last_change":"2024-09-10T21:06:07.736240+0000","last_active":"2024-09-10T21:06:13.105840+0000","last_peered":"2024-09-10T21:06:13.105840+0000","last_clean":"2024-09-10T21:06:13.105840+0000","last_became_active":"2024-09-10T21:06:07.735925+0000","last_became_peered":"2024-09-10T21:06:07.735925+0000","last_unstale":"2024-09-10T21:06:13.105840+0000","last_undegraded":"2024-09-10T21:06:13.105840+0000","last_fullsized":"2024-09-10T21:06:13.105840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:38.292268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106193+0000","last_change":"2024-09-10T21:06:06.736359+0000","last_active":"2024-09-10T21:06:13.106193+0000","last_peered":"2024-09-10T21:06:13.106193+0000","last_clean":"2024-09-10T21:06:13.106193+0000","last_became_active":"2024-09-10T21:06:06.736050+0000","last_became_peered":"2024-09-10T21:06:06.736050+0000","last_unstale":"2024-09-10T21:06:13.106193+0000","last_undegraded":"2024-09-10T21:06:13.106193+0000","last_fullsized":"2024-09-10T21:06:13.106193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:23.541255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755047+0000","last_change":"2024-09-10T21:06:11.777086+0000","last_active":"2024-09-10T21:06:12.755047+0000","last_peered":"2024-09-10T21:06:12.755047+0000","last_clean":"2024-09-10T21:06:12.755047+0000","last_became_active":"2024-09-10T21:06:11.775942+0000","last_became_peered":"2024-09-10T21:06:11.775942+0000","last_unstale":"2024-09-10T21:06:12.755047+0000","last_undegraded":"2024-09-10T21:06:12.755047+0000","last_fullsized":"2024-09-10T21:06:12.755047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:32.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105699+0000","last_change":"2024-09-10T21:06:07.733238+0000","last_active":"2024-09-10T21:06:13.105699+0000","last_peered":"2024-09-10T21:06:13.105699+0000","last_clean":"2024-09-10T21:06:13.105699+0000","last_became_active":"2024-09-10T21:06:07.732976+0000","last_became_peered":"2024-09-10T21:06:07.732976+0000","last_unstale":"2024-09-10T21:06:13.105699+0000","last_undegraded":"2024-09-10T21:06:13.105699+0000","last_fullsized":"2024-09-10T21:06:13.105699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.194600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.750898+0000","last_change":"2024-09-10T21:06:06.729612+0000","last_active":"2024-09-10T21:06:12.750898+0000","last_peered":"2024-09-10T21:06:12.750898+0000","last_clean":"2024-09-10T21:06:12.750898+0000","last_became_active":"2024-09-10T21:06:06.729273+0000","last_became_peered":"2024-09-10T21:06:06.729273+0000","last_unstale":"2024-09-10T21:06:12.750898+0000","last_undegraded":"2024-09-10T21:06:12.750898+0000","last_fullsized":"2024-09-10T21:06:12.750898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:31.995655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107550+0000","last_change":"2024-09-10T21:06:11.775010+0000","last_active":"2024-09-10T21:06:13.107550+0000","last_peered":"2024-09-10T21:06:13.107550+0000","last_clean":"2024-09-10T21:06:13.107550+0000","last_became_active":"2024-09-10T21:06:11.774620+0000","last_became_peered":"2024-09-10T21:06:11.774620+0000","last_unstale":"2024-09-10T21:06:13.107550+0000","last_undegraded":"2024-09-10T21:06:13.107550+0000","last_fullsized":"2024-09-10T21:06:13.107550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:16.623420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106018+0000","last_change":"2024-09-10T21:06:07.738509+0000","last_active":"2024-09-10T21:06:13.106018+0000","last_peered":"2024-09-10T21:06:13.106018+0000","last_clean":"2024-09-10T21:06:13.106018+0000","last_became_active":"2024-09-10T21:06:07.738191+0000","last_became_peered":"2024-09-10T21:06:07.738191+0000","last_unstale":"2024-09-10T21:06:13.106018+0000","last_undegraded":"2024-09-10T21:06:13.106018+0000","last_fullsized":"2024-09-10T21:06:13.106018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:55.563240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107096+0000","last_change":"2024-09-10T21:06:06.729882+0000","last_active":"2024-09-10T21:06:13.107096+0000","last_peered":"2024-09-10T21:06:13.107096+0000","last_clean":"2024-09-10T21:06:13.107096+0000","last_became_active":"2024-09-10T21:06:06.729598+0000","last_became_peered":"2024-09-10T21:06:06.729598+0000","last_unstale":"2024-09-10T21:06:13.107096+0000","last_undegraded":"2024-09-10T21:06:13.107096+0000","last_fullsized":"2024-09-10T21:06:13.107096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105187+0000","last_change":"2024-09-10T21:06:11.773911+0000","last_active":"2024-09-10T21:06:13.105187+0000","last_peered":"2024-09-10T21:06:13.105187+0000","last_clean":"2024-09-10T21:06:13.105187+0000","last_became_active":"2024-09-10T21:06:11.773571+0000","last_became_peered":"2024-09-10T21:06:11.773571+0000","last_unstale":"2024-09-10T21:06:13.105187+0000","last_undegraded":"2024-09-10T21:06:13.105187+0000","last_fullsized":"2024-09-10T21:06:13.105187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:59.082471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106726+0000","last_change":"2024-09-10T21:06:07.744529+0000","last_active":"2024-09-10T21:06:13.106726+0000","last_peered":"2024-09-10T21:06:13.106726+0000","last_clean":"2024-09-10T21:06:13.106726+0000","last_became_active":"2024-09-10T21:06:07.744283+0000","last_became_peered":"2024-09-10T21:06:07.744283+0000","last_unstale":"2024-09-10T21:06:13.106726+0000","last_undegraded":"2024-09-10T21:06:13.106726+0000","last_fullsized":"2024-09-10T21:06:13.106726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:22.708264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106805+0000","last_change":"2024-09-10T21:06:06.735762+0000","last_active":"2024-09-10T21:06:13.106805+0000","last_peered":"2024-09-10T21:06:13.106805+0000","last_clean":"2024-09-10T21:06:13.106805+0000","last_became_active":"2024-09-10T21:06:06.735504+0000","last_became_peered":"2024-09-10T21:06:06.735504+0000","last_unstale":"2024-09-10T21:06:13.106805+0000","last_undegraded":"2024-09-10T21:06:13.106805+0000","last_fullsized":"2024-09-10T21:06:13.106805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:30.893513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105651+0000","last_change":"2024-09-10T21:06:11.759166+0000","last_active":"2024-09-10T21:06:13.105651+0000","last_peered":"2024-09-10T21:06:13.105651+0000","last_clean":"2024-09-10T21:06:13.105651+0000","last_became_active":"2024-09-10T21:06:11.758731+0000","last_became_peered":"2024-09-10T21:06:11.758731+0000","last_unstale":"2024-09-10T21:06:13.105651+0000","last_undegraded":"2024-09-10T21:06:13.105651+0000","last_fullsized":"2024-09-10T21:06:13.105651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:35.741616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106957+0000","last_change":"2024-09-10T21:06:07.730449+0000","last_active":"2024-09-10T21:06:13.106957+0000","last_peered":"2024-09-10T21:06:13.106957+0000","last_clean":"2024-09-10T21:06:13.106957+0000","last_became_active":"2024-09-10T21:06:07.730138+0000","last_became_peered":"2024-09-10T21:06:07.730138+0000","last_unstale":"2024-09-10T21:06:13.106957+0000","last_undegraded":"2024-09-10T21:06:13.106957+0000","last_fullsized":"2024-09-10T21:06:13.106957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:52.489450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106921+0000","last_change":"2024-09-10T21:06:06.733157+0000","last_active":"2024-09-10T21:06:13.106921+0000","last_peered":"2024-09-10T21:06:13.106921+0000","last_clean":"2024-09-10T21:06:13.106921+0000","last_became_active":"2024-09-10T21:06:06.731969+0000","last_became_peered":"2024-09-10T21:06:06.731969+0000","last_unstale":"2024-09-10T21:06:13.106921+0000","last_undegraded":"2024-09-10T21:06:13.106921+0000","last_fullsized":"2024-09-10T21:06:13.106921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:29.608127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106173+0000","last_change":"2024-09-10T21:06:11.765210+0000","last_active":"2024-09-10T21:06:13.106173+0000","last_peered":"2024-09-10T21:06:13.106173+0000","last_clean":"2024-09-10T21:06:13.106173+0000","last_became_active":"2024-09-10T21:06:11.764692+0000","last_became_peered":"2024-09-10T21:06:11.764692+0000","last_unstale":"2024-09-10T21:06:13.106173+0000","last_undegraded":"2024-09-10T21:06:13.106173+0000","last_fullsized":"2024-09-10T21:06:13.106173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:43.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107298+0000","last_change":"2024-09-10T21:06:07.740729+0000","last_active":"2024-09-10T21:06:13.107298+0000","last_peered":"2024-09-10T21:06:13.107298+0000","last_clean":"2024-09-10T21:06:13.107298+0000","last_became_active":"2024-09-10T21:06:07.740268+0000","last_became_peered":"2024-09-10T21:06:07.740268+0000","last_unstale":"2024-09-10T21:06:13.107298+0000","last_undegraded":"2024-09-10T21:06:13.107298+0000","last_fullsized":"2024-09-10T21:06:13.107298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095917+0000","last_change":"2024-09-10T21:06:06.727108+0000","last_active":"2024-09-10T21:06:13.095917+0000","last_peered":"2024-09-10T21:06:13.095917+0000","last_clean":"2024-09-10T21:06:13.095917+0000","last_became_active":"2024-09-10T21:06:06.724197+0000","last_became_peered":"2024-09-10T21:06:06.724197+0000","last_unstale":"2024-09-10T21:06:13.095917+0000","last_undegraded":"2024-09-10T21:06:13.095917+0000","last_fullsized":"2024-09-10T21:06:13.095917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:42.221414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105780+0000","last_change":"2024-09-10T21:06:11.761088+0000","last_active":"2024-09-10T21:06:13.105780+0000","last_peered":"2024-09-10T21:06:13.105780+0000","last_clean":"2024-09-10T21:06:13.105780+0000","last_became_active":"2024-09-10T21:06:11.760606+0000","last_became_peered":"2024-09-10T21:06:11.760606+0000","last_unstale":"2024-09-10T21:06:13.105780+0000","last_undegraded":"2024-09-10T21:06:13.105780+0000","last_fullsized":"2024-09-10T21:06:13.105780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:55.529656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751220+0000","last_change":"2024-09-10T21:06:07.740212+0000","last_active":"2024-09-10T21:06:12.751220+0000","last_peered":"2024-09-10T21:06:12.751220+0000","last_clean":"2024-09-10T21:06:12.751220+0000","last_became_active":"2024-09-10T21:06:07.739862+0000","last_became_peered":"2024-09-10T21:06:07.739862+0000","last_unstale":"2024-09-10T21:06:12.751220+0000","last_undegraded":"2024-09-10T21:06:12.751220+0000","last_fullsized":"2024-09-10T21:06:12.751220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:59.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105875+0000","last_change":"2024-09-10T21:06:06.720349+0000","last_active":"2024-09-10T21:06:13.105875+0000","last_peered":"2024-09-10T21:06:13.105875+0000","last_clean":"2024-09-10T21:06:13.105875+0000","last_became_active":"2024-09-10T21:06:06.719193+0000","last_became_peered":"2024-09-10T21:06:06.719193+0000","last_unstale":"2024-09-10T21:06:13.105875+0000","last_undegraded":"2024-09-10T21:06:13.105875+0000","last_fullsized":"2024-09-10T21:06:13.105875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:14.047312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106576+0000","last_change":"2024-09-10T21:06:11.764876+0000","last_active":"2024-09-10T21:06:13.106576+0000","last_peered":"2024-09-10T21:06:13.106576+0000","last_clean":"2024-09-10T21:06:13.106576+0000","last_became_active":"2024-09-10T21:06:11.762830+0000","last_became_peered":"2024-09-10T21:06:11.762830+0000","last_unstale":"2024-09-10T21:06:13.106576+0000","last_undegraded":"2024-09-10T21:06:13.106576+0000","last_fullsized":"2024-09-10T21:06:13.106576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.820369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095486+0000","last_change":"2024-09-10T21:06:07.728902+0000","last_active":"2024-09-10T21:06:13.095486+0000","last_peered":"2024-09-10T21:06:13.095486+0000","last_clean":"2024-09-10T21:06:13.095486+0000","last_became_active":"2024-09-10T21:06:07.727554+0000","last_became_peered":"2024-09-10T21:06:07.727554+0000","last_unstale":"2024-09-10T21:06:13.095486+0000","last_undegraded":"2024-09-10T21:06:13.095486+0000","last_fullsized":"2024-09-10T21:06:13.095486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:30.750244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754573+0000","last_change":"2024-09-10T21:06:06.738792+0000","last_active":"2024-09-10T21:06:12.754573+0000","last_peered":"2024-09-10T21:06:12.754573+0000","last_clean":"2024-09-10T21:06:12.754573+0000","last_became_active":"2024-09-10T21:06:06.735261+0000","last_became_peered":"2024-09-10T21:06:06.735261+0000","last_unstale":"2024-09-10T21:06:12.754573+0000","last_undegraded":"2024-09-10T21:06:12.754573+0000","last_fullsized":"2024-09-10T21:06:12.754573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:04.060073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107278+0000","last_change":"2024-09-10T21:06:11.759571+0000","last_active":"2024-09-10T21:06:13.107278+0000","last_peered":"2024-09-10T21:06:13.107278+0000","last_clean":"2024-09-10T21:06:13.107278+0000","last_became_active":"2024-09-10T21:06:11.758333+0000","last_became_peered":"2024-09-10T21:06:11.758333+0000","last_unstale":"2024-09-10T21:06:13.107278+0000","last_undegraded":"2024-09-10T21:06:13.107278+0000","last_fullsized":"2024-09-10T21:06:13.107278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:19.666141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105462+0000","last_change":"2024-09-10T21:06:07.730355+0000","last_active":"2024-09-10T21:06:13.105462+0000","last_peered":"2024-09-10T21:06:13.105462+0000","last_clean":"2024-09-10T21:06:13.105462+0000","last_became_active":"2024-09-10T21:06:07.728407+0000","last_became_peered":"2024-09-10T21:06:07.728407+0000","last_unstale":"2024-09-10T21:06:13.105462+0000","last_undegraded":"2024-09-10T21:06:13.105462+0000","last_fullsized":"2024-09-10T21:06:13.105462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105889+0000","last_change":"2024-09-10T21:06:06.724834+0000","last_active":"2024-09-10T21:06:13.105889+0000","last_peered":"2024-09-10T21:06:13.105889+0000","last_clean":"2024-09-10T21:06:13.105889+0000","last_became_active":"2024-09-10T21:06:06.723605+0000","last_became_peered":"2024-09-10T21:06:06.723605+0000","last_unstale":"2024-09-10T21:06:13.105889+0000","last_undegraded":"2024-09-10T21:06:13.105889+0000","last_fullsized":"2024-09-10T21:06:13.105889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:49.300851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096160+0000","last_change":"2024-09-10T21:06:11.775310+0000","last_active":"2024-09-10T21:06:13.096160+0000","last_peered":"2024-09-10T21:06:13.096160+0000","last_clean":"2024-09-10T21:06:13.096160+0000","last_became_active":"2024-09-10T21:06:11.774927+0000","last_became_peered":"2024-09-10T21:06:11.774927+0000","last_unstale":"2024-09-10T21:06:13.096160+0000","last_undegraded":"2024-09-10T21:06:13.096160+0000","last_fullsized":"2024-09-10T21:06:13.096160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:57.504941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105855+0000","last_change":"2024-09-10T21:06:07.744943+0000","last_active":"2024-09-10T21:06:13.105855+0000","last_peered":"2024-09-10T21:06:13.105855+0000","last_clean":"2024-09-10T21:06:13.105855+0000","last_became_active":"2024-09-10T21:06:07.744127+0000","last_became_peered":"2024-09-10T21:06:07.744127+0000","last_unstale":"2024-09-10T21:06:13.105855+0000","last_undegraded":"2024-09-10T21:06:13.105855+0000","last_fullsized":"2024-09-10T21:06:13.105855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:56.096951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106075+0000","last_change":"2024-09-10T21:06:06.732794+0000","last_active":"2024-09-10T21:06:13.106075+0000","last_peered":"2024-09-10T21:06:13.106075+0000","last_clean":"2024-09-10T21:06:13.106075+0000","last_became_active":"2024-09-10T21:06:06.732524+0000","last_became_peered":"2024-09-10T21:06:06.732524+0000","last_unstale":"2024-09-10T21:06:13.106075+0000","last_undegraded":"2024-09-10T21:06:13.106075+0000","last_fullsized":"2024-09-10T21:06:13.106075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:52.521141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754500+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:06:12.754500+0000","last_peered":"2024-09-10T21:06:12.754500+0000","last_clean":"2024-09-10T21:06:12.754500+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:06:12.754500+0000","last_undegraded":"2024-09-10T21:06:12.754500+0000","last_fullsized":"2024-09-10T21:06:12.754500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106695+0000","last_change":"2024-09-10T21:06:11.771513+0000","last_active":"2024-09-10T21:06:13.106695+0000","last_peered":"2024-09-10T21:06:13.106695+0000","last_clean":"2024-09-10T21:06:13.106695+0000","last_became_active":"2024-09-10T21:06:11.771109+0000","last_became_peered":"2024-09-10T21:06:11.771109+0000","last_unstale":"2024-09-10T21:06:13.106695+0000","last_undegraded":"2024-09-10T21:06:13.106695+0000","last_fullsized":"2024-09-10T21:06:13.106695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:52.565604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106557+0000","last_change":"2024-09-10T21:06:07.735827+0000","last_active":"2024-09-10T21:06:13.106557+0000","last_peered":"2024-09-10T21:06:13.106557+0000","last_clean":"2024-09-10T21:06:13.106557+0000","last_became_active":"2024-09-10T21:06:07.735570+0000","last_became_peered":"2024-09-10T21:06:07.735570+0000","last_unstale":"2024-09-10T21:06:13.106557+0000","last_undegraded":"2024-09-10T21:06:13.106557+0000","last_fullsized":"2024-09-10T21:06:13.106557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:26.644366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107030+0000","last_change":"2024-09-10T21:06:06.736508+0000","last_active":"2024-09-10T21:06:13.107030+0000","last_peered":"2024-09-10T21:06:13.107030+0000","last_clean":"2024-09-10T21:06:13.107030+0000","last_became_active":"2024-09-10T21:06:06.733786+0000","last_became_peered":"2024-09-10T21:06:06.733786+0000","last_unstale":"2024-09-10T21:06:13.107030+0000","last_undegraded":"2024-09-10T21:06:13.107030+0000","last_fullsized":"2024-09-10T21:06:13.107030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:20.425789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106109+0000","last_change":"2024-09-10T21:06:11.773388+0000","last_active":"2024-09-10T21:06:13.106109+0000","last_peered":"2024-09-10T21:06:13.106109+0000","last_clean":"2024-09-10T21:06:13.106109+0000","last_became_active":"2024-09-10T21:06:11.773037+0000","last_became_peered":"2024-09-10T21:06:11.773037+0000","last_unstale":"2024-09-10T21:06:13.106109+0000","last_undegraded":"2024-09-10T21:06:13.106109+0000","last_fullsized":"2024-09-10T21:06:13.106109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:19.666141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751686+0000","last_change":"2024-09-10T21:06:07.741169+0000","last_active":"2024-09-10T21:06:12.751686+0000","last_peered":"2024-09-10T21:06:12.751686+0000","last_clean":"2024-09-10T21:06:12.751686+0000","last_became_active":"2024-09-10T21:06:07.732016+0000","last_became_peered":"2024-09-10T21:06:07.732016+0000","last_unstale":"2024-09-10T21:06:12.751686+0000","last_undegraded":"2024-09-10T21:06:12.751686+0000","last_fullsized":"2024-09-10T21:06:12.751686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:31.704899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096056+0000","last_change":"2024-09-10T21:06:06.723528+0000","last_active":"2024-09-10T21:06:13.096056+0000","last_peered":"2024-09-10T21:06:13.096056+0000","last_clean":"2024-09-10T21:06:13.096056+0000","last_became_active":"2024-09-10T21:06:06.723230+0000","last_became_peered":"2024-09-10T21:06:06.723230+0000","last_unstale":"2024-09-10T21:06:13.096056+0000","last_undegraded":"2024-09-10T21:06:13.096056+0000","last_fullsized":"2024-09-10T21:06:13.096056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:38.577023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095831+0000","last_change":"2024-09-10T21:06:11.764290+0000","last_active":"2024-09-10T21:06:13.095831+0000","last_peered":"2024-09-10T21:06:13.095831+0000","last_clean":"2024-09-10T21:06:13.095831+0000","last_became_active":"2024-09-10T21:06:11.763048+0000","last_became_peered":"2024-09-10T21:06:11.763048+0000","last_unstale":"2024-09-10T21:06:13.095831+0000","last_undegraded":"2024-09-10T21:06:13.095831+0000","last_fullsized":"2024-09-10T21:06:13.095831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:16.973732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751824+0000","last_change":"2024-09-10T21:06:07.747804+0000","last_active":"2024-09-10T21:06:12.751824+0000","last_peered":"2024-09-10T21:06:12.751824+0000","last_clean":"2024-09-10T21:06:12.751824+0000","last_became_active":"2024-09-10T21:06:07.747314+0000","last_became_peered":"2024-09-10T21:06:07.747314+0000","last_unstale":"2024-09-10T21:06:12.751824+0000","last_undegraded":"2024-09-10T21:06:12.751824+0000","last_fullsized":"2024-09-10T21:06:12.751824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:12.784568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106675+0000","last_change":"2024-09-10T21:06:06.733973+0000","last_active":"2024-09-10T21:06:13.106675+0000","last_peered":"2024-09-10T21:06:13.106675+0000","last_clean":"2024-09-10T21:06:13.106675+0000","last_became_active":"2024-09-10T21:06:06.733657+0000","last_became_peered":"2024-09-10T21:06:06.733657+0000","last_unstale":"2024-09-10T21:06:13.106675+0000","last_undegraded":"2024-09-10T21:06:13.106675+0000","last_fullsized":"2024-09-10T21:06:13.106675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.848743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105337+0000","last_change":"2024-09-10T21:06:11.772129+0000","last_active":"2024-09-10T21:06:13.105337+0000","last_peered":"2024-09-10T21:06:13.105337+0000","last_clean":"2024-09-10T21:06:13.105337+0000","last_became_active":"2024-09-10T21:06:11.771760+0000","last_became_peered":"2024-09-10T21:06:11.771760+0000","last_unstale":"2024-09-10T21:06:13.105337+0000","last_undegraded":"2024-09-10T21:06:13.105337+0000","last_fullsized":"2024-09-10T21:06:13.105337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:19.126960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107660+0000","last_change":"2024-09-10T21:06:07.740671+0000","last_active":"2024-09-10T21:06:13.107660+0000","last_peered":"2024-09-10T21:06:13.107660+0000","last_clean":"2024-09-10T21:06:13.107660+0000","last_became_active":"2024-09-10T21:06:07.740358+0000","last_became_peered":"2024-09-10T21:06:07.740358+0000","last_unstale":"2024-09-10T21:06:13.107660+0000","last_undegraded":"2024-09-10T21:06:13.107660+0000","last_fullsized":"2024-09-10T21:06:13.107660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:23.671822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751972+0000","last_change":"2024-09-10T21:06:06.733420+0000","last_active":"2024-09-10T21:06:12.751972+0000","last_peered":"2024-09-10T21:06:12.751972+0000","last_clean":"2024-09-10T21:06:12.751972+0000","last_became_active":"2024-09-10T21:06:06.733124+0000","last_became_peered":"2024-09-10T21:06:06.733124+0000","last_unstale":"2024-09-10T21:06:12.751972+0000","last_undegraded":"2024-09-10T21:06:12.751972+0000","last_fullsized":"2024-09-10T21:06:12.751972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.848743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754527+0000","last_change":"2024-09-10T21:06:11.765124+0000","last_active":"2024-09-10T21:06:12.754527+0000","last_peered":"2024-09-10T21:06:12.754527+0000","last_clean":"2024-09-10T21:06:12.754527+0000","last_became_active":"2024-09-10T21:06:11.764737+0000","last_became_peered":"2024-09-10T21:06:11.764737+0000","last_unstale":"2024-09-10T21:06:12.754527+0000","last_undegraded":"2024-09-10T21:06:12.754527+0000","last_fullsized":"2024-09-10T21:06:12.754527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:54.343216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105542+0000","last_change":"2024-09-10T21:06:07.722858+0000","last_active":"2024-09-10T21:06:13.105542+0000","last_peered":"2024-09-10T21:06:13.105542+0000","last_clean":"2024-09-10T21:06:13.105542+0000","last_became_active":"2024-09-10T21:06:07.722606+0000","last_became_peered":"2024-09-10T21:06:07.722606+0000","last_unstale":"2024-09-10T21:06:13.105542+0000","last_undegraded":"2024-09-10T21:06:13.105542+0000","last_fullsized":"2024-09-10T21:06:13.105542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:12.784568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105962+0000","last_change":"2024-09-10T21:06:06.732829+0000","last_active":"2024-09-10T21:06:13.105962+0000","last_peered":"2024-09-10T21:06:13.105962+0000","last_clean":"2024-09-10T21:06:13.105962+0000","last_became_active":"2024-09-10T21:06:06.732330+0000","last_became_peered":"2024-09-10T21:06:06.732330+0000","last_unstale":"2024-09-10T21:06:13.105962+0000","last_undegraded":"2024-09-10T21:06:13.105962+0000","last_fullsized":"2024-09-10T21:06:13.105962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:31.995655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096366+0000","last_change":"2024-09-10T21:06:11.770617+0000","last_active":"2024-09-10T21:06:13.096366+0000","last_peered":"2024-09-10T21:06:13.096366+0000","last_clean":"2024-09-10T21:06:13.096366+0000","last_became_active":"2024-09-10T21:06:11.770181+0000","last_became_peered":"2024-09-10T21:06:11.770181+0000","last_unstale":"2024-09-10T21:06:13.096366+0000","last_undegraded":"2024-09-10T21:06:13.096366+0000","last_fullsized":"2024-09-10T21:06:13.096366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:24.035068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754317+0000","last_change":"2024-09-10T21:06:07.736943+0000","last_active":"2024-09-10T21:06:12.754317+0000","last_peered":"2024-09-10T21:06:12.754317+0000","last_clean":"2024-09-10T21:06:12.754317+0000","last_became_active":"2024-09-10T21:06:07.734718+0000","last_became_peered":"2024-09-10T21:06:07.734718+0000","last_unstale":"2024-09-10T21:06:12.754317+0000","last_undegraded":"2024-09-10T21:06:12.754317+0000","last_fullsized":"2024-09-10T21:06:12.754317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751075+0000","last_change":"2024-09-10T21:06:06.721908+0000","last_active":"2024-09-10T21:06:12.751075+0000","last_peered":"2024-09-10T21:06:12.751075+0000","last_clean":"2024-09-10T21:06:12.751075+0000","last_became_active":"2024-09-10T21:06:06.721632+0000","last_became_peered":"2024-09-10T21:06:06.721632+0000","last_unstale":"2024-09-10T21:06:12.751075+0000","last_undegraded":"2024-09-10T21:06:12.751075+0000","last_fullsized":"2024-09-10T21:06:12.751075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:23.541255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096704+0000","last_change":"2024-09-10T21:06:11.778809+0000","last_active":"2024-09-10T21:06:13.096704+0000","last_peered":"2024-09-10T21:06:13.096704+0000","last_clean":"2024-09-10T21:06:13.096704+0000","last_became_active":"2024-09-10T21:06:11.773850+0000","last_became_peered":"2024-09-10T21:06:11.773850+0000","last_unstale":"2024-09-10T21:06:13.096704+0000","last_undegraded":"2024-09-10T21:06:13.096704+0000","last_fullsized":"2024-09-10T21:06:13.096704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:31.261505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105504+0000","last_change":"2024-09-10T21:06:07.748130+0000","last_active":"2024-09-10T21:06:13.105504+0000","last_peered":"2024-09-10T21:06:13.105504+0000","last_clean":"2024-09-10T21:06:13.105504+0000","last_became_active":"2024-09-10T21:06:07.747878+0000","last_became_peered":"2024-09-10T21:06:07.747878+0000","last_unstale":"2024-09-10T21:06:13.105504+0000","last_undegraded":"2024-09-10T21:06:13.105504+0000","last_fullsized":"2024-09-10T21:06:13.105504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:59.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105808+0000","last_change":"2024-09-10T21:06:06.726018+0000","last_active":"2024-09-10T21:06:13.105808+0000","last_peered":"2024-09-10T21:06:13.105808+0000","last_clean":"2024-09-10T21:06:13.105808+0000","last_became_active":"2024-09-10T21:06:06.725738+0000","last_became_peered":"2024-09-10T21:06:06.725738+0000","last_unstale":"2024-09-10T21:06:13.105808+0000","last_undegraded":"2024-09-10T21:06:13.105808+0000","last_fullsized":"2024-09-10T21:06:13.105808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:56.619842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105827+0000","last_change":"2024-09-10T21:06:11.765453+0000","last_active":"2024-09-10T21:06:13.105827+0000","last_peered":"2024-09-10T21:06:13.105827+0000","last_clean":"2024-09-10T21:06:13.105827+0000","last_became_active":"2024-09-10T21:06:11.764276+0000","last_became_peered":"2024-09-10T21:06:11.764276+0000","last_unstale":"2024-09-10T21:06:13.105827+0000","last_undegraded":"2024-09-10T21:06:13.105827+0000","last_fullsized":"2024-09-10T21:06:13.105827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:05.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106078+0000","last_change":"2024-09-10T21:06:07.735444+0000","last_active":"2024-09-10T21:06:13.106078+0000","last_peered":"2024-09-10T21:06:13.106078+0000","last_clean":"2024-09-10T21:06:13.106078+0000","last_became_active":"2024-09-10T21:06:07.734064+0000","last_became_peered":"2024-09-10T21:06:07.734064+0000","last_unstale":"2024-09-10T21:06:13.106078+0000","last_undegraded":"2024-09-10T21:06:13.106078+0000","last_fullsized":"2024-09-10T21:06:13.106078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:30.575576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755368+0000","last_change":"2024-09-10T21:06:06.735638+0000","last_active":"2024-09-10T21:06:12.755368+0000","last_peered":"2024-09-10T21:06:12.755368+0000","last_clean":"2024-09-10T21:06:12.755368+0000","last_became_active":"2024-09-10T21:06:06.735293+0000","last_became_peered":"2024-09-10T21:06:06.735293+0000","last_unstale":"2024-09-10T21:06:12.755368+0000","last_undegraded":"2024-09-10T21:06:12.755368+0000","last_fullsized":"2024-09-10T21:06:12.755368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:24.628433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106316+0000","last_change":"2024-09-10T21:06:11.764039+0000","last_active":"2024-09-10T21:06:13.106316+0000","last_peered":"2024-09-10T21:06:13.106316+0000","last_clean":"2024-09-10T21:06:13.106316+0000","last_became_active":"2024-09-10T21:06:11.763682+0000","last_became_peered":"2024-09-10T21:06:11.763682+0000","last_unstale":"2024-09-10T21:06:13.106316+0000","last_undegraded":"2024-09-10T21:06:13.106316+0000","last_fullsized":"2024-09-10T21:06:13.106316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:16.839314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751619+0000","last_change":"2024-09-10T21:06:07.738236+0000","last_active":"2024-09-10T21:06:12.751619+0000","last_peered":"2024-09-10T21:06:12.751619+0000","last_clean":"2024-09-10T21:06:12.751619+0000","last_became_active":"2024-09-10T21:06:07.737917+0000","last_became_peered":"2024-09-10T21:06:07.737917+0000","last_unstale":"2024-09-10T21:06:12.751619+0000","last_undegraded":"2024-09-10T21:06:12.751619+0000","last_fullsized":"2024-09-10T21:06:12.751619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:55.077742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:18.188883+0000","last_change":"2024-09-10T21:06:06.731715+0000","last_active":"2024-09-10T21:06:18.188883+0000","last_peered":"2024-09-10T21:06:18.188883+0000","last_clean":"2024-09-10T21:06:18.188883+0000","last_became_active":"2024-09-10T21:06:06.731420+0000","last_became_peered":"2024-09-10T21:06:06.731420+0000","last_unstale":"2024-09-10T21:06:18.188883+0000","last_undegraded":"2024-09-10T21:06:18.188883+0000","last_fullsized":"2024-09-10T21:06:18.188883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:33.538737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106144+0000","last_change":"2024-09-10T21:06:11.762541+0000","last_active":"2024-09-10T21:06:13.106144+0000","last_peered":"2024-09-10T21:06:13.106144+0000","last_clean":"2024-09-10T21:06:13.106144+0000","last_became_active":"2024-09-10T21:06:11.762102+0000","last_became_peered":"2024-09-10T21:06:11.762102+0000","last_unstale":"2024-09-10T21:06:13.106144+0000","last_undegraded":"2024-09-10T21:06:13.106144+0000","last_fullsized":"2024-09-10T21:06:13.106144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:59.114459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106254+0000","last_change":"2024-09-10T21:06:07.724490+0000","last_active":"2024-09-10T21:06:13.106254+0000","last_peered":"2024-09-10T21:06:13.106254+0000","last_clean":"2024-09-10T21:06:13.106254+0000","last_became_active":"2024-09-10T21:06:07.724157+0000","last_became_peered":"2024-09-10T21:06:07.724157+0000","last_unstale":"2024-09-10T21:06:13.106254+0000","last_undegraded":"2024-09-10T21:06:13.106254+0000","last_fullsized":"2024-09-10T21:06:13.106254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:23.477983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755368+0000","last_change":"2024-09-10T21:06:06.739360+0000","last_active":"2024-09-10T21:06:12.755368+0000","last_peered":"2024-09-10T21:06:12.755368+0000","last_clean":"2024-09-10T21:06:12.755368+0000","last_became_active":"2024-09-10T21:06:06.739136+0000","last_became_peered":"2024-09-10T21:06:06.739136+0000","last_unstale":"2024-09-10T21:06:12.755368+0000","last_undegraded":"2024-09-10T21:06:12.755368+0000","last_fullsized":"2024-09-10T21:06:12.755368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:42.131131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106640+0000","last_change":"2024-09-10T21:06:11.775845+0000","last_active":"2024-09-10T21:06:13.106640+0000","last_peered":"2024-09-10T21:06:13.106640+0000","last_clean":"2024-09-10T21:06:13.106640+0000","last_became_active":"2024-09-10T21:06:11.775460+0000","last_became_peered":"2024-09-10T21:06:11.775460+0000","last_unstale":"2024-09-10T21:06:13.106640+0000","last_undegraded":"2024-09-10T21:06:13.106640+0000","last_fullsized":"2024-09-10T21:06:13.106640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.820369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096792+0000","last_change":"2024-09-10T21:06:07.732030+0000","last_active":"2024-09-10T21:06:13.096792+0000","last_peered":"2024-09-10T21:06:13.096792+0000","last_clean":"2024-09-10T21:06:13.096792+0000","last_became_active":"2024-09-10T21:06:07.731726+0000","last_became_peered":"2024-09-10T21:06:07.731726+0000","last_unstale":"2024-09-10T21:06:13.096792+0000","last_undegraded":"2024-09-10T21:06:13.096792+0000","last_fullsized":"2024-09-10T21:06:13.096792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:51.701343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751643+0000","last_change":"2024-09-10T21:06:06.724643+0000","last_active":"2024-09-10T21:06:12.751643+0000","last_peered":"2024-09-10T21:06:12.751643+0000","last_clean":"2024-09-10T21:06:12.751643+0000","last_became_active":"2024-09-10T21:06:06.724348+0000","last_became_peered":"2024-09-10T21:06:06.724348+0000","last_unstale":"2024-09-10T21:06:12.751643+0000","last_undegraded":"2024-09-10T21:06:12.751643+0000","last_fullsized":"2024-09-10T21:06:12.751643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:14.047312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754380+0000","last_change":"2024-09-10T21:06:11.772999+0000","last_active":"2024-09-10T21:06:12.754380+0000","last_peered":"2024-09-10T21:06:12.754380+0000","last_clean":"2024-09-10T21:06:12.754380+0000","last_became_active":"2024-09-10T21:06:11.771544+0000","last_became_peered":"2024-09-10T21:06:11.771544+0000","last_unstale":"2024-09-10T21:06:12.754380+0000","last_undegraded":"2024-09-10T21:06:12.754380+0000","last_fullsized":"2024-09-10T21:06:12.754380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:10.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107606+0000","last_change":"2024-09-10T21:06:07.737581+0000","last_active":"2024-09-10T21:06:13.107606+0000","last_peered":"2024-09-10T21:06:13.107606+0000","last_clean":"2024-09-10T21:06:13.107606+0000","last_became_active":"2024-09-10T21:06:07.737246+0000","last_became_peered":"2024-09-10T21:06:07.737246+0000","last_unstale":"2024-09-10T21:06:13.107606+0000","last_undegraded":"2024-09-10T21:06:13.107606+0000","last_fullsized":"2024-09-10T21:06:13.107606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755005+0000","last_change":"2024-09-10T21:06:06.736661+0000","last_active":"2024-09-10T21:06:12.755005+0000","last_peered":"2024-09-10T21:06:12.755005+0000","last_clean":"2024-09-10T21:06:12.755005+0000","last_became_active":"2024-09-10T21:06:06.736356+0000","last_became_peered":"2024-09-10T21:06:06.736356+0000","last_unstale":"2024-09-10T21:06:12.755005+0000","last_undegraded":"2024-09-10T21:06:12.755005+0000","last_fullsized":"2024-09-10T21:06:12.755005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:20.425789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105911+0000","last_change":"2024-09-10T21:06:11.760467+0000","last_active":"2024-09-10T21:06:13.105911+0000","last_peered":"2024-09-10T21:06:13.105911+0000","last_clean":"2024-09-10T21:06:13.105911+0000","last_became_active":"2024-09-10T21:06:11.760101+0000","last_became_peered":"2024-09-10T21:06:11.760101+0000","last_unstale":"2024-09-10T21:06:13.105911+0000","last_undegraded":"2024-09-10T21:06:13.105911+0000","last_fullsized":"2024-09-10T21:06:13.105911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:03.280132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106059+0000","last_change":"2024-09-10T21:06:11.763190+0000","last_active":"2024-09-10T21:06:13.106059+0000","last_peered":"2024-09-10T21:06:13.106059+0000","last_clean":"2024-09-10T21:06:13.106059+0000","last_became_active":"2024-09-10T21:06:11.758968+0000","last_became_peered":"2024-09-10T21:06:11.758968+0000","last_unstale":"2024-09-10T21:06:13.106059+0000","last_undegraded":"2024-09-10T21:06:13.106059+0000","last_fullsized":"2024-09-10T21:06:13.106059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:16.821284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106076+0000","last_change":"2024-09-10T21:06:07.747586+0000","last_active":"2024-09-10T21:06:13.106076+0000","last_peered":"2024-09-10T21:06:13.106076+0000","last_clean":"2024-09-10T21:06:13.106076+0000","last_became_active":"2024-09-10T21:06:07.745029+0000","last_became_peered":"2024-09-10T21:06:07.745029+0000","last_unstale":"2024-09-10T21:06:13.106076+0000","last_undegraded":"2024-09-10T21:06:13.106076+0000","last_fullsized":"2024-09-10T21:06:13.106076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.948769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105798+0000","last_change":"2024-09-10T21:06:06.719711+0000","last_active":"2024-09-10T21:06:13.105798+0000","last_peered":"2024-09-10T21:06:13.105798+0000","last_clean":"2024-09-10T21:06:13.105798+0000","last_became_active":"2024-09-10T21:06:06.719461+0000","last_became_peered":"2024-09-10T21:06:06.719461+0000","last_unstale":"2024-09-10T21:06:13.105798+0000","last_undegraded":"2024-09-10T21:06:13.105798+0000","last_fullsized":"2024-09-10T21:06:13.105798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:05.884744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106296+0000","last_change":"2024-09-10T21:06:11.763903+0000","last_active":"2024-09-10T21:06:13.106296+0000","last_peered":"2024-09-10T21:06:13.106296+0000","last_clean":"2024-09-10T21:06:13.106296+0000","last_became_active":"2024-09-10T21:06:11.763549+0000","last_became_peered":"2024-09-10T21:06:11.763549+0000","last_unstale":"2024-09-10T21:06:13.106296+0000","last_undegraded":"2024-09-10T21:06:13.106296+0000","last_fullsized":"2024-09-10T21:06:13.106296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:28.790789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095775+0000","last_change":"2024-09-10T21:06:07.736045+0000","last_active":"2024-09-10T21:06:13.095775+0000","last_peered":"2024-09-10T21:06:13.095775+0000","last_clean":"2024-09-10T21:06:13.095775+0000","last_became_active":"2024-09-10T21:06:07.733458+0000","last_became_peered":"2024-09-10T21:06:07.733458+0000","last_unstale":"2024-09-10T21:06:13.095775+0000","last_undegraded":"2024-09-10T21:06:13.095775+0000","last_fullsized":"2024-09-10T21:06:13.095775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:31.627773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105575+0000","last_change":"2024-09-10T21:06:06.729442+0000","last_active":"2024-09-10T21:06:13.105575+0000","last_peered":"2024-09-10T21:06:13.105575+0000","last_clean":"2024-09-10T21:06:13.105575+0000","last_became_active":"2024-09-10T21:06:06.729045+0000","last_became_peered":"2024-09-10T21:06:06.729045+0000","last_unstale":"2024-09-10T21:06:13.105575+0000","last_undegraded":"2024-09-10T21:06:13.105575+0000","last_fullsized":"2024-09-10T21:06:13.105575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:35.821653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105776+0000","last_change":"2024-09-10T21:06:06.728511+0000","last_active":"2024-09-10T21:06:13.105776+0000","last_peered":"2024-09-10T21:06:13.105776+0000","last_clean":"2024-09-10T21:06:13.105776+0000","last_became_active":"2024-09-10T21:06:06.728200+0000","last_became_peered":"2024-09-10T21:06:06.728200+0000","last_unstale":"2024-09-10T21:06:13.105776+0000","last_undegraded":"2024-09-10T21:06:13.105776+0000","last_fullsized":"2024-09-10T21:06:13.105776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:30.893513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106622+0000","last_change":"2024-09-10T21:06:07.750023+0000","last_active":"2024-09-10T21:06:13.106622+0000","last_peered":"2024-09-10T21:06:13.106622+0000","last_clean":"2024-09-10T21:06:13.106622+0000","last_became_active":"2024-09-10T21:06:07.749735+0000","last_became_peered":"2024-09-10T21:06:07.749735+0000","last_unstale":"2024-09-10T21:06:13.106622+0000","last_undegraded":"2024-09-10T21:06:13.106622+0000","last_fullsized":"2024-09-10T21:06:13.106622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:09.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106429+0000","last_change":"2024-09-10T21:06:11.764282+0000","last_active":"2024-09-10T21:06:13.106429+0000","last_peered":"2024-09-10T21:06:13.106429+0000","last_clean":"2024-09-10T21:06:13.106429+0000","last_became_active":"2024-09-10T21:06:11.763052+0000","last_became_peered":"2024-09-10T21:06:11.763052+0000","last_unstale":"2024-09-10T21:06:13.106429+0000","last_undegraded":"2024-09-10T21:06:13.106429+0000","last_fullsized":"2024-09-10T21:06:13.106429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:49.419399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096049+0000","last_change":"2024-09-10T21:06:06.724502+0000","last_active":"2024-09-10T21:06:13.096049+0000","last_peered":"2024-09-10T21:06:13.096049+0000","last_clean":"2024-09-10T21:06:13.096049+0000","last_became_active":"2024-09-10T21:06:06.723257+0000","last_became_peered":"2024-09-10T21:06:06.723257+0000","last_unstale":"2024-09-10T21:06:13.096049+0000","last_undegraded":"2024-09-10T21:06:13.096049+0000","last_fullsized":"2024-09-10T21:06:13.096049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:33.839048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754544+0000","last_change":"2024-09-10T21:06:07.731233+0000","last_active":"2024-09-10T21:06:12.754544+0000","last_peered":"2024-09-10T21:06:12.754544+0000","last_clean":"2024-09-10T21:06:12.754544+0000","last_became_active":"2024-09-10T21:06:07.730548+0000","last_became_peered":"2024-09-10T21:06:07.730548+0000","last_unstale":"2024-09-10T21:06:12.754544+0000","last_undegraded":"2024-09-10T21:06:12.754544+0000","last_fullsized":"2024-09-10T21:06:12.754544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755250+0000","last_change":"2024-09-10T21:06:11.774785+0000","last_active":"2024-09-10T21:06:12.755250+0000","last_peered":"2024-09-10T21:06:12.755250+0000","last_clean":"2024-09-10T21:06:12.755250+0000","last_became_active":"2024-09-10T21:06:11.774346+0000","last_became_peered":"2024-09-10T21:06:11.774346+0000","last_unstale":"2024-09-10T21:06:12.755250+0000","last_undegraded":"2024-09-10T21:06:12.755250+0000","last_fullsized":"2024-09-10T21:06:12.755250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:02.110289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105230+0000","last_change":"2024-09-10T21:06:07.740108+0000","last_active":"2024-09-10T21:06:13.105230+0000","last_peered":"2024-09-10T21:06:13.105230+0000","last_clean":"2024-09-10T21:06:13.105230+0000","last_became_active":"2024-09-10T21:06:07.739794+0000","last_became_peered":"2024-09-10T21:06:07.739794+0000","last_unstale":"2024-09-10T21:06:13.105230+0000","last_undegraded":"2024-09-10T21:06:13.105230+0000","last_fullsized":"2024-09-10T21:06:13.105230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754458+0000","last_change":"2024-09-10T21:06:07.733770+0000","last_active":"2024-09-10T21:06:12.754458+0000","last_peered":"2024-09-10T21:06:12.754458+0000","last_clean":"2024-09-10T21:06:12.754458+0000","last_became_active":"2024-09-10T21:06:07.733519+0000","last_became_peered":"2024-09-10T21:06:07.733519+0000","last_unstale":"2024-09-10T21:06:12.754458+0000","last_undegraded":"2024-09-10T21:06:12.754458+0000","last_fullsized":"2024-09-10T21:06:12.754458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105599+0000","last_change":"2024-09-10T21:06:07.722573+0000","last_active":"2024-09-10T21:06:13.105599+0000","last_peered":"2024-09-10T21:06:13.105599+0000","last_clean":"2024-09-10T21:06:13.105599+0000","last_became_active":"2024-09-10T21:06:07.722291+0000","last_became_peered":"2024-09-10T21:06:07.722291+0000","last_unstale":"2024-09-10T21:06:13.105599+0000","last_undegraded":"2024-09-10T21:06:13.105599+0000","last_fullsized":"2024-09-10T21:06:13.105599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:24.676940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095949+0000","last_change":"2024-09-10T21:06:07.725057+0000","last_active":"2024-09-10T21:06:13.095949+0000","last_peered":"2024-09-10T21:06:13.095949+0000","last_clean":"2024-09-10T21:06:13.095949+0000","last_became_active":"2024-09-10T21:06:07.724777+0000","last_became_peered":"2024-09-10T21:06:07.724777+0000","last_unstale":"2024-09-10T21:06:13.095949+0000","last_undegraded":"2024-09-10T21:06:13.095949+0000","last_fullsized":"2024-09-10T21:06:13.095949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:05.565224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106908+0000","last_change":"2024-09-10T21:06:07.735771+0000","last_active":"2024-09-10T21:06:13.106908+0000","last_peered":"2024-09-10T21:06:13.106908+0000","last_clean":"2024-09-10T21:06:13.106908+0000","last_became_active":"2024-09-10T21:06:07.735447+0000","last_became_peered":"2024-09-10T21:06:07.735447+0000","last_unstale":"2024-09-10T21:06:13.106908+0000","last_undegraded":"2024-09-10T21:06:13.106908+0000","last_fullsized":"2024-09-10T21:06:13.106908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:21.629321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107117+0000","last_change":"2024-09-10T21:06:07.726407+0000","last_active":"2024-09-10T21:06:13.107117+0000","last_peered":"2024-09-10T21:06:13.107117+0000","last_clean":"2024-09-10T21:06:13.107117+0000","last_became_active":"2024-09-10T21:06:07.726061+0000","last_became_peered":"2024-09-10T21:06:07.726061+0000","last_unstale":"2024-09-10T21:06:13.107117+0000","last_undegraded":"2024-09-10T21:06:13.107117+0000","last_fullsized":"2024-09-10T21:06:13.107117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:23.671822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107518+0000","last_change":"2024-09-10T21:06:07.737552+0000","last_active":"2024-09-10T21:06:13.107518+0000","last_peered":"2024-09-10T21:06:13.107518+0000","last_clean":"2024-09-10T21:06:13.107518+0000","last_became_active":"2024-09-10T21:06:07.737253+0000","last_became_peered":"2024-09-10T21:06:07.737253+0000","last_unstale":"2024-09-10T21:06:13.107518+0000","last_undegraded":"2024-09-10T21:06:13.107518+0000","last_fullsized":"2024-09-10T21:06:13.107518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:43.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096602+0000","last_change":"2024-09-10T21:06:07.738429+0000","last_active":"2024-09-10T21:06:13.096602+0000","last_peered":"2024-09-10T21:06:13.096602+0000","last_clean":"2024-09-10T21:06:13.096602+0000","last_became_active":"2024-09-10T21:06:07.736750+0000","last_became_peered":"2024-09-10T21:06:07.736750+0000","last_unstale":"2024-09-10T21:06:13.096602+0000","last_undegraded":"2024-09-10T21:06:13.096602+0000","last_fullsized":"2024-09-10T21:06:13.096602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:15.172285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105703+0000","last_change":"2024-09-10T21:06:07.727750+0000","last_active":"2024-09-10T21:06:13.105703+0000","last_peered":"2024-09-10T21:06:13.105703+0000","last_clean":"2024-09-10T21:06:13.105703+0000","last_became_active":"2024-09-10T21:06:07.727492+0000","last_became_peered":"2024-09-10T21:06:07.727492+0000","last_unstale":"2024-09-10T21:06:13.105703+0000","last_undegraded":"2024-09-10T21:06:13.105703+0000","last_fullsized":"2024-09-10T21:06:13.105703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:45.382683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095636+0000","last_change":"2024-09-10T21:06:07.734497+0000","last_active":"2024-09-10T21:06:13.095636+0000","last_peered":"2024-09-10T21:06:13.095636+0000","last_clean":"2024-09-10T21:06:13.095636+0000","last_became_active":"2024-09-10T21:06:07.731837+0000","last_became_peered":"2024-09-10T21:06:07.731837+0000","last_unstale":"2024-09-10T21:06:13.095636+0000","last_undegraded":"2024-09-10T21:06:13.095636+0000","last_fullsized":"2024-09-10T21:06:13.095636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:10.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754456+0000","last_change":"2024-09-10T21:06:07.731385+0000","last_active":"2024-09-10T21:06:12.754456+0000","last_peered":"2024-09-10T21:06:12.754456+0000","last_clean":"2024-09-10T21:06:12.754456+0000","last_became_active":"2024-09-10T21:06:07.730952+0000","last_became_peered":"2024-09-10T21:06:07.730952+0000","last_unstale":"2024-09-10T21:06:12.754456+0000","last_undegraded":"2024-09-10T21:06:12.754456+0000","last_fullsized":"2024-09-10T21:06:12.754456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106509+0000","last_change":"2024-09-10T21:06:07.743829+0000","last_active":"2024-09-10T21:06:13.106509+0000","last_peered":"2024-09-10T21:06:13.106509+0000","last_clean":"2024-09-10T21:06:13.106509+0000","last_became_active":"2024-09-10T21:06:07.743556+0000","last_became_peered":"2024-09-10T21:06:07.743556+0000","last_unstale":"2024-09-10T21:06:13.106509+0000","last_undegraded":"2024-09-10T21:06:13.106509+0000","last_fullsized":"2024-09-10T21:06:13.106509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:58.073572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751609+0000","last_change":"2024-09-10T21:06:07.731428+0000","last_active":"2024-09-10T21:06:12.751609+0000","last_peered":"2024-09-10T21:06:12.751609+0000","last_clean":"2024-09-10T21:06:12.751609+0000","last_became_active":"2024-09-10T21:06:07.731151+0000","last_became_peered":"2024-09-10T21:06:07.731151+0000","last_unstale":"2024-09-10T21:06:12.751609+0000","last_undegraded":"2024-09-10T21:06:12.751609+0000","last_fullsized":"2024-09-10T21:06:12.751609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:10.318478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106834+0000","last_change":"2024-09-10T21:06:07.729264+0000","last_active":"2024-09-10T21:06:13.106834+0000","last_peered":"2024-09-10T21:06:13.106834+0000","last_clean":"2024-09-10T21:06:13.106834+0000","last_became_active":"2024-09-10T21:06:07.729001+0000","last_became_peered":"2024-09-10T21:06:07.729001+0000","last_unstale":"2024-09-10T21:06:13.106834+0000","last_undegraded":"2024-09-10T21:06:13.106834+0000","last_fullsized":"2024-09-10T21:06:13.106834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:13.030165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754965+0000","last_change":"2024-09-10T21:06:07.729035+0000","last_active":"2024-09-10T21:06:12.754965+0000","last_peered":"2024-09-10T21:06:12.754965+0000","last_clean":"2024-09-10T21:06:12.754965+0000","last_became_active":"2024-09-10T21:06:07.728726+0000","last_became_peered":"2024-09-10T21:06:07.728726+0000","last_unstale":"2024-09-10T21:06:12.754965+0000","last_undegraded":"2024-09-10T21:06:12.754965+0000","last_fullsized":"2024-09-10T21:06:12.754965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107040+0000","last_change":"2024-09-10T21:06:07.727552+0000","last_active":"2024-09-10T21:06:13.107040+0000","last_peered":"2024-09-10T21:06:13.107040+0000","last_clean":"2024-09-10T21:06:13.107040+0000","last_became_active":"2024-09-10T21:06:07.727247+0000","last_became_peered":"2024-09-10T21:06:07.727247+0000","last_unstale":"2024-09-10T21:06:13.107040+0000","last_undegraded":"2024-09-10T21:06:13.107040+0000","last_fullsized":"2024-09-10T21:06:13.107040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:17.742182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105603+0000","last_change":"2024-09-10T21:06:07.724043+0000","last_active":"2024-09-10T21:06:13.105603+0000","last_peered":"2024-09-10T21:06:13.105603+0000","last_clean":"2024-09-10T21:06:13.105603+0000","last_became_active":"2024-09-10T21:06:07.723760+0000","last_became_peered":"2024-09-10T21:06:07.723760+0000","last_unstale":"2024-09-10T21:06:13.105603+0000","last_undegraded":"2024-09-10T21:06:13.105603+0000","last_fullsized":"2024-09-10T21:06:13.105603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:31.704899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095465+0000","last_change":"2024-09-10T21:06:07.731993+0000","last_active":"2024-09-10T21:06:13.095465+0000","last_peered":"2024-09-10T21:06:13.095465+0000","last_clean":"2024-09-10T21:06:13.095465+0000","last_became_active":"2024-09-10T21:06:07.728201+0000","last_became_peered":"2024-09-10T21:06:07.728201+0000","last_unstale":"2024-09-10T21:06:13.095465+0000","last_undegraded":"2024-09-10T21:06:13.095465+0000","last_fullsized":"2024-09-10T21:06:13.095465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:37.030681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105964+0000","last_change":"2024-09-10T21:06:07.726441+0000","last_active":"2024-09-10T21:06:13.105964+0000","last_peered":"2024-09-10T21:06:13.105964+0000","last_clean":"2024-09-10T21:06:13.105964+0000","last_became_active":"2024-09-10T21:06:07.726129+0000","last_became_peered":"2024-09-10T21:06:07.726129+0000","last_unstale":"2024-09-10T21:06:13.105964+0000","last_undegraded":"2024-09-10T21:06:13.105964+0000","last_fullsized":"2024-09-10T21:06:13.105964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:50.280191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106522+0000","last_change":"2024-09-10T21:06:07.745674+0000","last_active":"2024-09-10T21:06:13.106522+0000","last_peered":"2024-09-10T21:06:13.106522+0000","last_clean":"2024-09-10T21:06:13.106522+0000","last_became_active":"2024-09-10T21:06:07.745377+0000","last_became_peered":"2024-09-10T21:06:07.745377+0000","last_unstale":"2024-09-10T21:06:13.106522+0000","last_undegraded":"2024-09-10T21:06:13.106522+0000","last_fullsized":"2024-09-10T21:06:13.106522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:58.465613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751580+0000","last_change":"2024-09-10T21:06:07.742353+0000","last_active":"2024-09-10T21:06:12.751580+0000","last_peered":"2024-09-10T21:06:12.751580+0000","last_clean":"2024-09-10T21:06:12.751580+0000","last_became_active":"2024-09-10T21:06:07.741768+0000","last_became_peered":"2024-09-10T21:06:07.741768+0000","last_unstale":"2024-09-10T21:06:12.751580+0000","last_undegraded":"2024-09-10T21:06:12.751580+0000","last_fullsized":"2024-09-10T21:06:12.751580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:21.303563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751664+0000","last_change":"2024-09-10T21:06:07.750182+0000","last_active":"2024-09-10T21:06:12.751664+0000","last_peered":"2024-09-10T21:06:12.751664+0000","last_clean":"2024-09-10T21:06:12.751664+0000","last_became_active":"2024-09-10T21:06:07.749545+0000","last_became_peered":"2024-09-10T21:06:07.749545+0000","last_unstale":"2024-09-10T21:06:12.751664+0000","last_undegraded":"2024-09-10T21:06:12.751664+0000","last_fullsized":"2024-09-10T21:06:12.751664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:01.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751610+0000","last_change":"2024-09-10T21:06:07.744262+0000","last_active":"2024-09-10T21:06:12.751610+0000","last_peered":"2024-09-10T21:06:12.751610+0000","last_clean":"2024-09-10T21:06:12.751610+0000","last_became_active":"2024-09-10T21:06:07.732781+0000","last_became_peered":"2024-09-10T21:06:07.732781+0000","last_unstale":"2024-09-10T21:06:12.751610+0000","last_undegraded":"2024-09-10T21:06:12.751610+0000","last_fullsized":"2024-09-10T21:06:12.751610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:58.650133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754980+0000","last_change":"2024-09-10T21:06:07.733975+0000","last_active":"2024-09-10T21:06:12.754980+0000","last_peered":"2024-09-10T21:06:12.754980+0000","last_clean":"2024-09-10T21:06:12.754980+0000","last_became_active":"2024-09-10T21:06:07.733715+0000","last_became_peered":"2024-09-10T21:06:07.733715+0000","last_unstale":"2024-09-10T21:06:12.754980+0000","last_undegraded":"2024-09-10T21:06:12.754980+0000","last_fullsized":"2024-09-10T21:06:12.754980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095474+0000","last_change":"2024-09-10T21:06:07.739522+0000","last_active":"2024-09-10T21:06:13.095474+0000","last_peered":"2024-09-10T21:06:13.095474+0000","last_clean":"2024-09-10T21:06:13.095474+0000","last_became_active":"2024-09-10T21:06:07.739162+0000","last_became_peered":"2024-09-10T21:06:07.739162+0000","last_unstale":"2024-09-10T21:06:13.095474+0000","last_undegraded":"2024-09-10T21:06:13.095474+0000","last_fullsized":"2024-09-10T21:06:13.095474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:03.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751051+0000","last_change":"2024-09-10T21:06:07.728083+0000","last_active":"2024-09-10T21:06:12.751051+0000","last_peered":"2024-09-10T21:06:12.751051+0000","last_clean":"2024-09-10T21:06:12.751051+0000","last_became_active":"2024-09-10T21:06:07.727804+0000","last_became_peered":"2024-09-10T21:06:07.727804+0000","last_unstale":"2024-09-10T21:06:12.751051+0000","last_undegraded":"2024-09-10T21:06:12.751051+0000","last_fullsized":"2024-09-10T21:06:12.751051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:04.725083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106825+0000","last_change":"2024-09-10T21:06:07.741270+0000","last_active":"2024-09-10T21:06:13.106825+0000","last_peered":"2024-09-10T21:06:13.106825+0000","last_clean":"2024-09-10T21:06:13.106825+0000","last_became_active":"2024-09-10T21:06:07.740584+0000","last_became_peered":"2024-09-10T21:06:07.740584+0000","last_unstale":"2024-09-10T21:06:13.106825+0000","last_undegraded":"2024-09-10T21:06:13.106825+0000","last_fullsized":"2024-09-10T21:06:13.106825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:52.489450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751331+0000","last_change":"2024-09-10T21:06:07.745169+0000","last_active":"2024-09-10T21:06:12.751331+0000","last_peered":"2024-09-10T21:06:12.751331+0000","last_clean":"2024-09-10T21:06:12.751331+0000","last_became_active":"2024-09-10T21:06:07.744772+0000","last_became_peered":"2024-09-10T21:06:07.744772+0000","last_unstale":"2024-09-10T21:06:12.751331+0000","last_undegraded":"2024-09-10T21:06:12.751331+0000","last_fullsized":"2024-09-10T21:06:12.751331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:03.406166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106982+0000","last_change":"2024-09-10T21:06:07.736065+0000","last_active":"2024-09-10T21:06:13.106982+0000","last_peered":"2024-09-10T21:06:13.106982+0000","last_clean":"2024-09-10T21:06:13.106982+0000","last_became_active":"2024-09-10T21:06:07.735732+0000","last_became_peered":"2024-09-10T21:06:07.735732+0000","last_unstale":"2024-09-10T21:06:13.106982+0000","last_undegraded":"2024-09-10T21:06:13.106982+0000","last_fullsized":"2024-09-10T21:06:13.106982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095910+0000","last_change":"2024-09-10T21:06:07.739765+0000","last_active":"2024-09-10T21:06:13.095910+0000","last_peered":"2024-09-10T21:06:13.095910+0000","last_clean":"2024-09-10T21:06:13.095910+0000","last_became_active":"2024-09-10T21:06:07.739457+0000","last_became_peered":"2024-09-10T21:06:07.739457+0000","last_unstale":"2024-09-10T21:06:13.095910+0000","last_undegraded":"2024-09-10T21:06:13.095910+0000","last_fullsized":"2024-09-10T21:06:13.095910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:58.818281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096192+0000","last_change":"2024-09-10T21:06:07.735873+0000","last_active":"2024-09-10T21:06:13.096192+0000","last_peered":"2024-09-10T21:06:13.096192+0000","last_clean":"2024-09-10T21:06:13.096192+0000","last_became_active":"2024-09-10T21:06:07.735589+0000","last_became_peered":"2024-09-10T21:06:07.735589+0000","last_unstale":"2024-09-10T21:06:13.096192+0000","last_undegraded":"2024-09-10T21:06:13.096192+0000","last_fullsized":"2024-09-10T21:06:13.096192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:26.970429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751832+0000","last_change":"2024-09-10T21:06:07.748933+0000","last_active":"2024-09-10T21:06:12.751832+0000","last_peered":"2024-09-10T21:06:12.751832+0000","last_clean":"2024-09-10T21:06:12.751832+0000","last_became_active":"2024-09-10T21:06:07.748659+0000","last_became_peered":"2024-09-10T21:06:07.748659+0000","last_unstale":"2024-09-10T21:06:12.751832+0000","last_undegraded":"2024-09-10T21:06:12.751832+0000","last_fullsized":"2024-09-10T21:06:12.751832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:26.789804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":114938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":112626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:06:24.810 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:06:25.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.995+0000 7f0925a00640 1 -- 172.21.15.100:0/524595733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f092015d8a0 msgr2=0x7f09200b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.995+0000 7f0925a00640 1 --2- 172.21.15.100:0/524595733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f092015d8a0 0x7f09200b3970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0910005fd0 tx=0x7f091002aa90 comp rx=0 tx=0).stop 2024-09-10T21:06:25.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.995+0000 7f0925a00640 1 -- 172.21.15.100:0/524595733 shutdown_connections 2024-09-10T21:06:25.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.995+0000 7f0925a00640 1 --2- 172.21.15.100:0/524595733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f092015d8a0 0x7f09200b3970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.995+0000 7f0925a00640 1 -- 172.21.15.100:0/524595733 >> 172.21.15.100:0/524595733 conn(0x7f092008d460 msgr2=0x7f092009cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:25.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.996+0000 7f0925a00640 1 -- 172.21.15.100:0/524595733 shutdown_connections 2024-09-10T21:06:25.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.996+0000 7f0925a00640 1 -- 172.21.15.100:0/524595733 wait complete. 2024-09-10T21:06:25.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.997+0000 7f0925a00640 1 Processor -- start 2024-09-10T21:06:25.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.997+0000 7f0925a00640 1 -- start start 2024-09-10T21:06:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f0925a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09200b5c20 0x7f09200b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f0925a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce5a0 0x7f092015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f0925a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f092015d8a0 0x7f09201f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f0925a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09200d07e0 con 0x7f09200ce5a0 2024-09-10T21:06:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f0925a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09200cee60 con 0x7f09200b5c20 2024-09-10T21:06:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f0925a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f09200d0960 con 0x7f092015d8a0 2024-09-10T21:06:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f091f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce5a0 0x7f092015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f091f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce5a0 0x7f092015c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34852/0 (socket says 172.21.15.100:34852) 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.998+0000 7f091f400640 1 -- 172.21.15.100:0/643281745 learned_addr learned my addr 172.21.15.100:0/643281745 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f091fe00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09200b5c20 0x7f09200b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f091f400640 1 -- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f092015d8a0 msgr2=0x7f09201f7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f0925000640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f092015d8a0 0x7f09201f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f091f400640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f092015d8a0 0x7f09201f7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f091f400640 1 -- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09200b5c20 msgr2=0x7f09200b8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f091f400640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09200b5c20 0x7f09200b8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f091f400640 1 -- 172.21.15.100:0/643281745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09200cc7a0 con 0x7f09200ce5a0 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f091fe00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09200b5c20 0x7f09200b8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f0925000640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f092015d8a0 0x7f09201f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f091f400640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce5a0 0x7f092015c390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f090c00c450 tx=0x7f090c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f0917e00640 1 -- 172.21.15.100:0/643281745 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c016020 con 0x7f09200ce5a0 2024-09-10T21:06:25.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f0917e00640 1 -- 172.21.15.100:0/643281745 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f090c012920 con 0x7f09200ce5a0 2024-09-10T21:06:25.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09200cca80 con 0x7f09200ce5a0 2024-09-10T21:06:25.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f0917e00640 1 -- 172.21.15.100:0/643281745 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c012d70 con 0x7f09200ce5a0 2024-09-10T21:06:25.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:24.999+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09200cd040 con 0x7f09200ce5a0 2024-09-10T21:06:25.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.001+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09200d0e70 con 0x7f09200ce5a0 2024-09-10T21:06:25.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.002+0000 7f0917e00640 1 -- 172.21.15.100:0/643281745 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f090c023060 con 0x7f09200ce5a0 2024-09-10T21:06:25.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.003+0000 7f0917e00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0900077f70 0x7f090007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.003+0000 7f0917e00640 1 -- 172.21.15.100:0/643281745 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f090c099fd0 con 0x7f09200ce5a0 2024-09-10T21:06:25.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.004+0000 7f091fe00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0900077f70 0x7f090007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.004+0000 7f091fe00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0900077f70 0x7f090007a430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0910035000 tx=0x7f0910004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:25.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.007+0000 7f0917e00640 1 -- 172.21.15.100:0/643281745 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f090c0626f0 con 0x7f09200ce5a0 2024-09-10T21:06:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.187+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09200b35c0 con 0x7f0900077f70 2024-09-10T21:06:25.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.193+0000 7f0917e00640 1 -- 172.21.15.100:0/643281745 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332543 (secure 0 0 0) 0x7f09200b35c0 con 0x7f0900077f70 2024-09-10T21:06:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:25.203 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:06:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0900077f70 msgr2=0x7f090007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0900077f70 0x7f090007a430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0910035000 tx=0x7f0910004ab0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce5a0 msgr2=0x7f092015c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce5a0 0x7f092015c390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f090c00c450 tx=0x7f090c00c910 comp rx=0 tx=0).stop 2024-09-10T21:06:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 shutdown_connections 2024-09-10T21:06:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f092015d8a0 0x7f09201f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09200ce5a0 0x7f092015c390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0900077f70 0x7f090007a430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 --2- 172.21.15.100:0/643281745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09200b5c20 0x7f09200b8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.197+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 >> 172.21.15.100:0/643281745 conn(0x7f092008d460 msgr2=0x7f092006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:25.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.198+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 shutdown_connections 2024-09-10T21:06:25.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.198+0000 7f0925a00640 1 -- 172.21.15.100:0/643281745 wait complete. 2024-09-10T21:06:25.218 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-10T21:06:24.690716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":148,"num_write_kb":1645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219660,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755060,"statfs":{"total":773094113280,"available":772869181440,"internally_reserved":0,"allocated":3514368,"data_stored":2072614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.937861"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106808+0000","last_change":"2024-09-10T21:06:06.737219+0000","last_active":"2024-09-10T21:06:13.106808+0000","last_peered":"2024-09-10T21:06:13.106808+0000","last_clean":"2024-09-10T21:06:13.106808+0000","last_became_active":"2024-09-10T21:06:06.736940+0000","last_became_peered":"2024-09-10T21:06:06.736940+0000","last_unstale":"2024-09-10T21:06:13.106808+0000","last_undegraded":"2024-09-10T21:06:13.106808+0000","last_fullsized":"2024-09-10T21:06:13.106808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096347+0000","last_change":"2024-09-10T21:06:07.729261+0000","last_active":"2024-09-10T21:06:13.096347+0000","last_peered":"2024-09-10T21:06:13.096347+0000","last_clean":"2024-09-10T21:06:13.096347+0000","last_became_active":"2024-09-10T21:06:07.728483+0000","last_became_peered":"2024-09-10T21:06:07.728483+0000","last_unstale":"2024-09-10T21:06:13.096347+0000","last_undegraded":"2024-09-10T21:06:13.096347+0000","last_fullsized":"2024-09-10T21:06:13.096347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:20.894078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754483+0000","last_change":"2024-09-10T21:06:11.772637+0000","last_active":"2024-09-10T21:06:12.754483+0000","last_peered":"2024-09-10T21:06:12.754483+0000","last_clean":"2024-09-10T21:06:12.754483+0000","last_became_active":"2024-09-10T21:06:11.771448+0000","last_became_peered":"2024-09-10T21:06:11.771448+0000","last_unstale":"2024-09-10T21:06:12.754483+0000","last_undegraded":"2024-09-10T21:06:12.754483+0000","last_fullsized":"2024-09-10T21:06:12.754483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:42.328984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096457+0000","last_change":"2024-09-10T21:06:06.732030+0000","last_active":"2024-09-10T21:06:13.096457+0000","last_peered":"2024-09-10T21:06:13.096457+0000","last_clean":"2024-09-10T21:06:13.096457+0000","last_became_active":"2024-09-10T21:06:06.731060+0000","last_became_peered":"2024-09-10T21:06:06.731060+0000","last_unstale":"2024-09-10T21:06:13.096457+0000","last_undegraded":"2024-09-10T21:06:13.096457+0000","last_fullsized":"2024-09-10T21:06:13.096457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:58.950962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096699+0000","last_change":"2024-09-10T21:06:07.738136+0000","last_active":"2024-09-10T21:06:13.096699+0000","last_peered":"2024-09-10T21:06:13.096699+0000","last_clean":"2024-09-10T21:06:13.096699+0000","last_became_active":"2024-09-10T21:06:07.737068+0000","last_became_peered":"2024-09-10T21:06:07.737068+0000","last_unstale":"2024-09-10T21:06:13.096699+0000","last_undegraded":"2024-09-10T21:06:13.096699+0000","last_fullsized":"2024-09-10T21:06:13.096699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:21.806911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105233+0000","last_change":"2024-09-10T21:06:11.779585+0000","last_active":"2024-09-10T21:06:13.105233+0000","last_peered":"2024-09-10T21:06:13.105233+0000","last_clean":"2024-09-10T21:06:13.105233+0000","last_became_active":"2024-09-10T21:06:11.779111+0000","last_became_peered":"2024-09-10T21:06:11.779111+0000","last_unstale":"2024-09-10T21:06:13.105233+0000","last_undegraded":"2024-09-10T21:06:13.105233+0000","last_fullsized":"2024-09-10T21:06:13.105233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:55.529656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751770+0000","last_change":"2024-09-10T21:06:06.730043+0000","last_active":"2024-09-10T21:06:12.751770+0000","last_peered":"2024-09-10T21:06:12.751770+0000","last_clean":"2024-09-10T21:06:12.751770+0000","last_became_active":"2024-09-10T21:06:06.729736+0000","last_became_peered":"2024-09-10T21:06:06.729736+0000","last_unstale":"2024-09-10T21:06:12.751770+0000","last_undegraded":"2024-09-10T21:06:12.751770+0000","last_fullsized":"2024-09-10T21:06:12.751770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:03.085613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754713+0000","last_change":"2024-09-10T21:06:07.749059+0000","last_active":"2024-09-10T21:06:12.754713+0000","last_peered":"2024-09-10T21:06:12.754713+0000","last_clean":"2024-09-10T21:06:12.754713+0000","last_became_active":"2024-09-10T21:06:07.748645+0000","last_became_peered":"2024-09-10T21:06:07.748645+0000","last_unstale":"2024-09-10T21:06:12.754713+0000","last_undegraded":"2024-09-10T21:06:12.754713+0000","last_fullsized":"2024-09-10T21:06:12.754713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:43.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106613+0000","last_change":"2024-09-10T21:06:11.774923+0000","last_active":"2024-09-10T21:06:13.106613+0000","last_peered":"2024-09-10T21:06:13.106613+0000","last_clean":"2024-09-10T21:06:13.106613+0000","last_became_active":"2024-09-10T21:06:11.774581+0000","last_became_peered":"2024-09-10T21:06:11.774581+0000","last_unstale":"2024-09-10T21:06:13.106613+0000","last_undegraded":"2024-09-10T21:06:13.106613+0000","last_fullsized":"2024-09-10T21:06:13.106613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:43.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751739+0000","last_change":"2024-09-10T21:06:06.725866+0000","last_active":"2024-09-10T21:06:12.751739+0000","last_peered":"2024-09-10T21:06:12.751739+0000","last_clean":"2024-09-10T21:06:12.751739+0000","last_became_active":"2024-09-10T21:06:06.725590+0000","last_became_peered":"2024-09-10T21:06:06.725590+0000","last_unstale":"2024-09-10T21:06:12.751739+0000","last_undegraded":"2024-09-10T21:06:12.751739+0000","last_fullsized":"2024-09-10T21:06:12.751739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106462+0000","last_change":"2024-09-10T21:06:07.748653+0000","last_active":"2024-09-10T21:06:13.106462+0000","last_peered":"2024-09-10T21:06:13.106462+0000","last_clean":"2024-09-10T21:06:13.106462+0000","last_became_active":"2024-09-10T21:06:07.748366+0000","last_became_peered":"2024-09-10T21:06:07.748366+0000","last_unstale":"2024-09-10T21:06:13.106462+0000","last_undegraded":"2024-09-10T21:06:13.106462+0000","last_fullsized":"2024-09-10T21:06:13.106462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:19.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105881+0000","last_change":"2024-09-10T21:06:11.768824+0000","last_active":"2024-09-10T21:06:13.105881+0000","last_peered":"2024-09-10T21:06:13.105881+0000","last_clean":"2024-09-10T21:06:13.105881+0000","last_became_active":"2024-09-10T21:06:11.768442+0000","last_became_peered":"2024-09-10T21:06:11.768442+0000","last_unstale":"2024-09-10T21:06:13.105881+0000","last_undegraded":"2024-09-10T21:06:13.105881+0000","last_fullsized":"2024-09-10T21:06:13.105881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:05.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105671+0000","last_change":"2024-09-10T21:06:07.733906+0000","last_active":"2024-09-10T21:06:13.105671+0000","last_peered":"2024-09-10T21:06:13.105671+0000","last_clean":"2024-09-10T21:06:13.105671+0000","last_became_active":"2024-09-10T21:06:07.733681+0000","last_became_peered":"2024-09-10T21:06:07.733681+0000","last_unstale":"2024-09-10T21:06:13.105671+0000","last_undegraded":"2024-09-10T21:06:13.105671+0000","last_fullsized":"2024-09-10T21:06:13.105671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:17.153627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106032+0000","last_change":"2024-09-10T21:06:06.732743+0000","last_active":"2024-09-10T21:06:13.106032+0000","last_peered":"2024-09-10T21:06:13.106032+0000","last_clean":"2024-09-10T21:06:13.106032+0000","last_became_active":"2024-09-10T21:06:06.732494+0000","last_became_peered":"2024-09-10T21:06:06.732494+0000","last_unstale":"2024-09-10T21:06:13.106032+0000","last_undegraded":"2024-09-10T21:06:13.106032+0000","last_fullsized":"2024-09-10T21:06:13.106032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:03.085613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107067+0000","last_change":"2024-09-10T21:06:11.777327+0000","last_active":"2024-09-10T21:06:13.107067+0000","last_peered":"2024-09-10T21:06:13.107067+0000","last_clean":"2024-09-10T21:06:13.107067+0000","last_became_active":"2024-09-10T21:06:11.771004+0000","last_became_peered":"2024-09-10T21:06:11.771004+0000","last_unstale":"2024-09-10T21:06:13.107067+0000","last_undegraded":"2024-09-10T21:06:13.107067+0000","last_fullsized":"2024-09-10T21:06:13.107067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:35.265715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755166+0000","last_change":"2024-09-10T21:06:07.734707+0000","last_active":"2024-09-10T21:06:12.755166+0000","last_peered":"2024-09-10T21:06:12.755166+0000","last_clean":"2024-09-10T21:06:12.755166+0000","last_became_active":"2024-09-10T21:06:07.733049+0000","last_became_peered":"2024-09-10T21:06:07.733049+0000","last_unstale":"2024-09-10T21:06:12.755166+0000","last_undegraded":"2024-09-10T21:06:12.755166+0000","last_fullsized":"2024-09-10T21:06:12.755166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106234+0000","last_change":"2024-09-10T21:06:06.720924+0000","last_active":"2024-09-10T21:06:13.106234+0000","last_peered":"2024-09-10T21:06:13.106234+0000","last_clean":"2024-09-10T21:06:13.106234+0000","last_became_active":"2024-09-10T21:06:06.719357+0000","last_became_peered":"2024-09-10T21:06:06.719357+0000","last_unstale":"2024-09-10T21:06:13.106234+0000","last_undegraded":"2024-09-10T21:06:13.106234+0000","last_fullsized":"2024-09-10T21:06:13.106234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:17.674783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751373+0000","last_change":"2024-09-10T21:06:11.771235+0000","last_active":"2024-09-10T21:06:12.751373+0000","last_peered":"2024-09-10T21:06:12.751373+0000","last_clean":"2024-09-10T21:06:12.751373+0000","last_became_active":"2024-09-10T21:06:11.770880+0000","last_became_peered":"2024-09-10T21:06:11.770880+0000","last_unstale":"2024-09-10T21:06:12.751373+0000","last_undegraded":"2024-09-10T21:06:12.751373+0000","last_fullsized":"2024-09-10T21:06:12.751373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:41.810392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105840+0000","last_change":"2024-09-10T21:06:07.736240+0000","last_active":"2024-09-10T21:06:13.105840+0000","last_peered":"2024-09-10T21:06:13.105840+0000","last_clean":"2024-09-10T21:06:13.105840+0000","last_became_active":"2024-09-10T21:06:07.735925+0000","last_became_peered":"2024-09-10T21:06:07.735925+0000","last_unstale":"2024-09-10T21:06:13.105840+0000","last_undegraded":"2024-09-10T21:06:13.105840+0000","last_fullsized":"2024-09-10T21:06:13.105840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:38.292268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106193+0000","last_change":"2024-09-10T21:06:06.736359+0000","last_active":"2024-09-10T21:06:13.106193+0000","last_peered":"2024-09-10T21:06:13.106193+0000","last_clean":"2024-09-10T21:06:13.106193+0000","last_became_active":"2024-09-10T21:06:06.736050+0000","last_became_peered":"2024-09-10T21:06:06.736050+0000","last_unstale":"2024-09-10T21:06:13.106193+0000","last_undegraded":"2024-09-10T21:06:13.106193+0000","last_fullsized":"2024-09-10T21:06:13.106193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:23.541255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755047+0000","last_change":"2024-09-10T21:06:11.777086+0000","last_active":"2024-09-10T21:06:12.755047+0000","last_peered":"2024-09-10T21:06:12.755047+0000","last_clean":"2024-09-10T21:06:12.755047+0000","last_became_active":"2024-09-10T21:06:11.775942+0000","last_became_peered":"2024-09-10T21:06:11.775942+0000","last_unstale":"2024-09-10T21:06:12.755047+0000","last_undegraded":"2024-09-10T21:06:12.755047+0000","last_fullsized":"2024-09-10T21:06:12.755047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:32.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105699+0000","last_change":"2024-09-10T21:06:07.733238+0000","last_active":"2024-09-10T21:06:13.105699+0000","last_peered":"2024-09-10T21:06:13.105699+0000","last_clean":"2024-09-10T21:06:13.105699+0000","last_became_active":"2024-09-10T21:06:07.732976+0000","last_became_peered":"2024-09-10T21:06:07.732976+0000","last_unstale":"2024-09-10T21:06:13.105699+0000","last_undegraded":"2024-09-10T21:06:13.105699+0000","last_fullsized":"2024-09-10T21:06:13.105699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.194600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.750898+0000","last_change":"2024-09-10T21:06:06.729612+0000","last_active":"2024-09-10T21:06:12.750898+0000","last_peered":"2024-09-10T21:06:12.750898+0000","last_clean":"2024-09-10T21:06:12.750898+0000","last_became_active":"2024-09-10T21:06:06.729273+0000","last_became_peered":"2024-09-10T21:06:06.729273+0000","last_unstale":"2024-09-10T21:06:12.750898+0000","last_undegraded":"2024-09-10T21:06:12.750898+0000","last_fullsized":"2024-09-10T21:06:12.750898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:31.995655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107550+0000","last_change":"2024-09-10T21:06:11.775010+0000","last_active":"2024-09-10T21:06:13.107550+0000","last_peered":"2024-09-10T21:06:13.107550+0000","last_clean":"2024-09-10T21:06:13.107550+0000","last_became_active":"2024-09-10T21:06:11.774620+0000","last_became_peered":"2024-09-10T21:06:11.774620+0000","last_unstale":"2024-09-10T21:06:13.107550+0000","last_undegraded":"2024-09-10T21:06:13.107550+0000","last_fullsized":"2024-09-10T21:06:13.107550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:16.623420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106018+0000","last_change":"2024-09-10T21:06:07.738509+0000","last_active":"2024-09-10T21:06:13.106018+0000","last_peered":"2024-09-10T21:06:13.106018+0000","last_clean":"2024-09-10T21:06:13.106018+0000","last_became_active":"2024-09-10T21:06:07.738191+0000","last_became_peered":"2024-09-10T21:06:07.738191+0000","last_unstale":"2024-09-10T21:06:13.106018+0000","last_undegraded":"2024-09-10T21:06:13.106018+0000","last_fullsized":"2024-09-10T21:06:13.106018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:55.563240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107096+0000","last_change":"2024-09-10T21:06:06.729882+0000","last_active":"2024-09-10T21:06:13.107096+0000","last_peered":"2024-09-10T21:06:13.107096+0000","last_clean":"2024-09-10T21:06:13.107096+0000","last_became_active":"2024-09-10T21:06:06.729598+0000","last_became_peered":"2024-09-10T21:06:06.729598+0000","last_unstale":"2024-09-10T21:06:13.107096+0000","last_undegraded":"2024-09-10T21:06:13.107096+0000","last_fullsized":"2024-09-10T21:06:13.107096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105187+0000","last_change":"2024-09-10T21:06:11.773911+0000","last_active":"2024-09-10T21:06:13.105187+0000","last_peered":"2024-09-10T21:06:13.105187+0000","last_clean":"2024-09-10T21:06:13.105187+0000","last_became_active":"2024-09-10T21:06:11.773571+0000","last_became_peered":"2024-09-10T21:06:11.773571+0000","last_unstale":"2024-09-10T21:06:13.105187+0000","last_undegraded":"2024-09-10T21:06:13.105187+0000","last_fullsized":"2024-09-10T21:06:13.105187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:59.082471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106726+0000","last_change":"2024-09-10T21:06:07.744529+0000","last_active":"2024-09-10T21:06:13.106726+0000","last_peered":"2024-09-10T21:06:13.106726+0000","last_clean":"2024-09-10T21:06:13.106726+0000","last_became_active":"2024-09-10T21:06:07.744283+0000","last_became_peered":"2024-09-10T21:06:07.744283+0000","last_unstale":"2024-09-10T21:06:13.106726+0000","last_undegraded":"2024-09-10T21:06:13.106726+0000","last_fullsized":"2024-09-10T21:06:13.106726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:22.708264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106805+0000","last_change":"2024-09-10T21:06:06.735762+0000","last_active":"2024-09-10T21:06:13.106805+0000","last_peered":"2024-09-10T21:06:13.106805+0000","last_clean":"2024-09-10T21:06:13.106805+0000","last_became_active":"2024-09-10T21:06:06.735504+0000","last_became_peered":"2024-09-10T21:06:06.735504+0000","last_unstale":"2024-09-10T21:06:13.106805+0000","last_undegraded":"2024-09-10T21:06:13.106805+0000","last_fullsized":"2024-09-10T21:06:13.106805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:30.893513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105651+0000","last_change":"2024-09-10T21:06:11.759166+0000","last_active":"2024-09-10T21:06:13.105651+0000","last_peered":"2024-09-10T21:06:13.105651+0000","last_clean":"2024-09-10T21:06:13.105651+0000","last_became_active":"2024-09-10T21:06:11.758731+0000","last_became_peered":"2024-09-10T21:06:11.758731+0000","last_unstale":"2024-09-10T21:06:13.105651+0000","last_undegraded":"2024-09-10T21:06:13.105651+0000","last_fullsized":"2024-09-10T21:06:13.105651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:35.741616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106957+0000","last_change":"2024-09-10T21:06:07.730449+0000","last_active":"2024-09-10T21:06:13.106957+0000","last_peered":"2024-09-10T21:06:13.106957+0000","last_clean":"2024-09-10T21:06:13.106957+0000","last_became_active":"2024-09-10T21:06:07.730138+0000","last_became_peered":"2024-09-10T21:06:07.730138+0000","last_unstale":"2024-09-10T21:06:13.106957+0000","last_undegraded":"2024-09-10T21:06:13.106957+0000","last_fullsized":"2024-09-10T21:06:13.106957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:52.489450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106921+0000","last_change":"2024-09-10T21:06:06.733157+0000","last_active":"2024-09-10T21:06:13.106921+0000","last_peered":"2024-09-10T21:06:13.106921+0000","last_clean":"2024-09-10T21:06:13.106921+0000","last_became_active":"2024-09-10T21:06:06.731969+0000","last_became_peered":"2024-09-10T21:06:06.731969+0000","last_unstale":"2024-09-10T21:06:13.106921+0000","last_undegraded":"2024-09-10T21:06:13.106921+0000","last_fullsized":"2024-09-10T21:06:13.106921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:29.608127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106173+0000","last_change":"2024-09-10T21:06:11.765210+0000","last_active":"2024-09-10T21:06:13.106173+0000","last_peered":"2024-09-10T21:06:13.106173+0000","last_clean":"2024-09-10T21:06:13.106173+0000","last_became_active":"2024-09-10T21:06:11.764692+0000","last_became_peered":"2024-09-10T21:06:11.764692+0000","last_unstale":"2024-09-10T21:06:13.106173+0000","last_undegraded":"2024-09-10T21:06:13.106173+0000","last_fullsized":"2024-09-10T21:06:13.106173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:43.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107298+0000","last_change":"2024-09-10T21:06:07.740729+0000","last_active":"2024-09-10T21:06:13.107298+0000","last_peered":"2024-09-10T21:06:13.107298+0000","last_clean":"2024-09-10T21:06:13.107298+0000","last_became_active":"2024-09-10T21:06:07.740268+0000","last_became_peered":"2024-09-10T21:06:07.740268+0000","last_unstale":"2024-09-10T21:06:13.107298+0000","last_undegraded":"2024-09-10T21:06:13.107298+0000","last_fullsized":"2024-09-10T21:06:13.107298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095917+0000","last_change":"2024-09-10T21:06:06.727108+0000","last_active":"2024-09-10T21:06:13.095917+0000","last_peered":"2024-09-10T21:06:13.095917+0000","last_clean":"2024-09-10T21:06:13.095917+0000","last_became_active":"2024-09-10T21:06:06.724197+0000","last_became_peered":"2024-09-10T21:06:06.724197+0000","last_unstale":"2024-09-10T21:06:13.095917+0000","last_undegraded":"2024-09-10T21:06:13.095917+0000","last_fullsized":"2024-09-10T21:06:13.095917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:42.221414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105780+0000","last_change":"2024-09-10T21:06:11.761088+0000","last_active":"2024-09-10T21:06:13.105780+0000","last_peered":"2024-09-10T21:06:13.105780+0000","last_clean":"2024-09-10T21:06:13.105780+0000","last_became_active":"2024-09-10T21:06:11.760606+0000","last_became_peered":"2024-09-10T21:06:11.760606+0000","last_unstale":"2024-09-10T21:06:13.105780+0000","last_undegraded":"2024-09-10T21:06:13.105780+0000","last_fullsized":"2024-09-10T21:06:13.105780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:55.529656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751220+0000","last_change":"2024-09-10T21:06:07.740212+0000","last_active":"2024-09-10T21:06:12.751220+0000","last_peered":"2024-09-10T21:06:12.751220+0000","last_clean":"2024-09-10T21:06:12.751220+0000","last_became_active":"2024-09-10T21:06:07.739862+0000","last_became_peered":"2024-09-10T21:06:07.739862+0000","last_unstale":"2024-09-10T21:06:12.751220+0000","last_undegraded":"2024-09-10T21:06:12.751220+0000","last_fullsized":"2024-09-10T21:06:12.751220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:59.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105875+0000","last_change":"2024-09-10T21:06:06.720349+0000","last_active":"2024-09-10T21:06:13.105875+0000","last_peered":"2024-09-10T21:06:13.105875+0000","last_clean":"2024-09-10T21:06:13.105875+0000","last_became_active":"2024-09-10T21:06:06.719193+0000","last_became_peered":"2024-09-10T21:06:06.719193+0000","last_unstale":"2024-09-10T21:06:13.105875+0000","last_undegraded":"2024-09-10T21:06:13.105875+0000","last_fullsized":"2024-09-10T21:06:13.105875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:14.047312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106576+0000","last_change":"2024-09-10T21:06:11.764876+0000","last_active":"2024-09-10T21:06:13.106576+0000","last_peered":"2024-09-10T21:06:13.106576+0000","last_clean":"2024-09-10T21:06:13.106576+0000","last_became_active":"2024-09-10T21:06:11.762830+0000","last_became_peered":"2024-09-10T21:06:11.762830+0000","last_unstale":"2024-09-10T21:06:13.106576+0000","last_undegraded":"2024-09-10T21:06:13.106576+0000","last_fullsized":"2024-09-10T21:06:13.106576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.820369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095486+0000","last_change":"2024-09-10T21:06:07.728902+0000","last_active":"2024-09-10T21:06:13.095486+0000","last_peered":"2024-09-10T21:06:13.095486+0000","last_clean":"2024-09-10T21:06:13.095486+0000","last_became_active":"2024-09-10T21:06:07.727554+0000","last_became_peered":"2024-09-10T21:06:07.727554+0000","last_unstale":"2024-09-10T21:06:13.095486+0000","last_undegraded":"2024-09-10T21:06:13.095486+0000","last_fullsized":"2024-09-10T21:06:13.095486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:30.750244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754573+0000","last_change":"2024-09-10T21:06:06.738792+0000","last_active":"2024-09-10T21:06:12.754573+0000","last_peered":"2024-09-10T21:06:12.754573+0000","last_clean":"2024-09-10T21:06:12.754573+0000","last_became_active":"2024-09-10T21:06:06.735261+0000","last_became_peered":"2024-09-10T21:06:06.735261+0000","last_unstale":"2024-09-10T21:06:12.754573+0000","last_undegraded":"2024-09-10T21:06:12.754573+0000","last_fullsized":"2024-09-10T21:06:12.754573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:04.060073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107278+0000","last_change":"2024-09-10T21:06:11.759571+0000","last_active":"2024-09-10T21:06:13.107278+0000","last_peered":"2024-09-10T21:06:13.107278+0000","last_clean":"2024-09-10T21:06:13.107278+0000","last_became_active":"2024-09-10T21:06:11.758333+0000","last_became_peered":"2024-09-10T21:06:11.758333+0000","last_unstale":"2024-09-10T21:06:13.107278+0000","last_undegraded":"2024-09-10T21:06:13.107278+0000","last_fullsized":"2024-09-10T21:06:13.107278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:19.666141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105462+0000","last_change":"2024-09-10T21:06:07.730355+0000","last_active":"2024-09-10T21:06:13.105462+0000","last_peered":"2024-09-10T21:06:13.105462+0000","last_clean":"2024-09-10T21:06:13.105462+0000","last_became_active":"2024-09-10T21:06:07.728407+0000","last_became_peered":"2024-09-10T21:06:07.728407+0000","last_unstale":"2024-09-10T21:06:13.105462+0000","last_undegraded":"2024-09-10T21:06:13.105462+0000","last_fullsized":"2024-09-10T21:06:13.105462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105889+0000","last_change":"2024-09-10T21:06:06.724834+0000","last_active":"2024-09-10T21:06:13.105889+0000","last_peered":"2024-09-10T21:06:13.105889+0000","last_clean":"2024-09-10T21:06:13.105889+0000","last_became_active":"2024-09-10T21:06:06.723605+0000","last_became_peered":"2024-09-10T21:06:06.723605+0000","last_unstale":"2024-09-10T21:06:13.105889+0000","last_undegraded":"2024-09-10T21:06:13.105889+0000","last_fullsized":"2024-09-10T21:06:13.105889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:49.300851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096160+0000","last_change":"2024-09-10T21:06:11.775310+0000","last_active":"2024-09-10T21:06:13.096160+0000","last_peered":"2024-09-10T21:06:13.096160+0000","last_clean":"2024-09-10T21:06:13.096160+0000","last_became_active":"2024-09-10T21:06:11.774927+0000","last_became_peered":"2024-09-10T21:06:11.774927+0000","last_unstale":"2024-09-10T21:06:13.096160+0000","last_undegraded":"2024-09-10T21:06:13.096160+0000","last_fullsized":"2024-09-10T21:06:13.096160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:57.504941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105855+0000","last_change":"2024-09-10T21:06:07.744943+0000","last_active":"2024-09-10T21:06:13.105855+0000","last_peered":"2024-09-10T21:06:13.105855+0000","last_clean":"2024-09-10T21:06:13.105855+0000","last_became_active":"2024-09-10T21:06:07.744127+0000","last_became_peered":"2024-09-10T21:06:07.744127+0000","last_unstale":"2024-09-10T21:06:13.105855+0000","last_undegraded":"2024-09-10T21:06:13.105855+0000","last_fullsized":"2024-09-10T21:06:13.105855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:56.096951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106075+0000","last_change":"2024-09-10T21:06:06.732794+0000","last_active":"2024-09-10T21:06:13.106075+0000","last_peered":"2024-09-10T21:06:13.106075+0000","last_clean":"2024-09-10T21:06:13.106075+0000","last_became_active":"2024-09-10T21:06:06.732524+0000","last_became_peered":"2024-09-10T21:06:06.732524+0000","last_unstale":"2024-09-10T21:06:13.106075+0000","last_undegraded":"2024-09-10T21:06:13.106075+0000","last_fullsized":"2024-09-10T21:06:13.106075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:52.521141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754500+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:06:12.754500+0000","last_peered":"2024-09-10T21:06:12.754500+0000","last_clean":"2024-09-10T21:06:12.754500+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:06:12.754500+0000","last_undegraded":"2024-09-10T21:06:12.754500+0000","last_fullsized":"2024-09-10T21:06:12.754500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106695+0000","last_change":"2024-09-10T21:06:11.771513+0000","last_active":"2024-09-10T21:06:13.106695+0000","last_peered":"2024-09-10T21:06:13.106695+0000","last_clean":"2024-09-10T21:06:13.106695+0000","last_became_active":"2024-09-10T21:06:11.771109+0000","last_became_peered":"2024-09-10T21:06:11.771109+0000","last_unstale":"2024-09-10T21:06:13.106695+0000","last_undegraded":"2024-09-10T21:06:13.106695+0000","last_fullsized":"2024-09-10T21:06:13.106695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:52.565604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106557+0000","last_change":"2024-09-10T21:06:07.735827+0000","last_active":"2024-09-10T21:06:13.106557+0000","last_peered":"2024-09-10T21:06:13.106557+0000","last_clean":"2024-09-10T21:06:13.106557+0000","last_became_active":"2024-09-10T21:06:07.735570+0000","last_became_peered":"2024-09-10T21:06:07.735570+0000","last_unstale":"2024-09-10T21:06:13.106557+0000","last_undegraded":"2024-09-10T21:06:13.106557+0000","last_fullsized":"2024-09-10T21:06:13.106557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:26.644366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107030+0000","last_change":"2024-09-10T21:06:06.736508+0000","last_active":"2024-09-10T21:06:13.107030+0000","last_peered":"2024-09-10T21:06:13.107030+0000","last_clean":"2024-09-10T21:06:13.107030+0000","last_became_active":"2024-09-10T21:06:06.733786+0000","last_became_peered":"2024-09-10T21:06:06.733786+0000","last_unstale":"2024-09-10T21:06:13.107030+0000","last_undegraded":"2024-09-10T21:06:13.107030+0000","last_fullsized":"2024-09-10T21:06:13.107030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:20.425789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106109+0000","last_change":"2024-09-10T21:06:11.773388+0000","last_active":"2024-09-10T21:06:13.106109+0000","last_peered":"2024-09-10T21:06:13.106109+0000","last_clean":"2024-09-10T21:06:13.106109+0000","last_became_active":"2024-09-10T21:06:11.773037+0000","last_became_peered":"2024-09-10T21:06:11.773037+0000","last_unstale":"2024-09-10T21:06:13.106109+0000","last_undegraded":"2024-09-10T21:06:13.106109+0000","last_fullsized":"2024-09-10T21:06:13.106109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:19.666141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751686+0000","last_change":"2024-09-10T21:06:07.741169+0000","last_active":"2024-09-10T21:06:12.751686+0000","last_peered":"2024-09-10T21:06:12.751686+0000","last_clean":"2024-09-10T21:06:12.751686+0000","last_became_active":"2024-09-10T21:06:07.732016+0000","last_became_peered":"2024-09-10T21:06:07.732016+0000","last_unstale":"2024-09-10T21:06:12.751686+0000","last_undegraded":"2024-09-10T21:06:12.751686+0000","last_fullsized":"2024-09-10T21:06:12.751686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:31.704899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096056+0000","last_change":"2024-09-10T21:06:06.723528+0000","last_active":"2024-09-10T21:06:13.096056+0000","last_peered":"2024-09-10T21:06:13.096056+0000","last_clean":"2024-09-10T21:06:13.096056+0000","last_became_active":"2024-09-10T21:06:06.723230+0000","last_became_peered":"2024-09-10T21:06:06.723230+0000","last_unstale":"2024-09-10T21:06:13.096056+0000","last_undegraded":"2024-09-10T21:06:13.096056+0000","last_fullsized":"2024-09-10T21:06:13.096056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:38.577023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095831+0000","last_change":"2024-09-10T21:06:11.764290+0000","last_active":"2024-09-10T21:06:13.095831+0000","last_peered":"2024-09-10T21:06:13.095831+0000","last_clean":"2024-09-10T21:06:13.095831+0000","last_became_active":"2024-09-10T21:06:11.763048+0000","last_became_peered":"2024-09-10T21:06:11.763048+0000","last_unstale":"2024-09-10T21:06:13.095831+0000","last_undegraded":"2024-09-10T21:06:13.095831+0000","last_fullsized":"2024-09-10T21:06:13.095831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:16.973732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751824+0000","last_change":"2024-09-10T21:06:07.747804+0000","last_active":"2024-09-10T21:06:12.751824+0000","last_peered":"2024-09-10T21:06:12.751824+0000","last_clean":"2024-09-10T21:06:12.751824+0000","last_became_active":"2024-09-10T21:06:07.747314+0000","last_became_peered":"2024-09-10T21:06:07.747314+0000","last_unstale":"2024-09-10T21:06:12.751824+0000","last_undegraded":"2024-09-10T21:06:12.751824+0000","last_fullsized":"2024-09-10T21:06:12.751824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:12.784568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106675+0000","last_change":"2024-09-10T21:06:06.733973+0000","last_active":"2024-09-10T21:06:13.106675+0000","last_peered":"2024-09-10T21:06:13.106675+0000","last_clean":"2024-09-10T21:06:13.106675+0000","last_became_active":"2024-09-10T21:06:06.733657+0000","last_became_peered":"2024-09-10T21:06:06.733657+0000","last_unstale":"2024-09-10T21:06:13.106675+0000","last_undegraded":"2024-09-10T21:06:13.106675+0000","last_fullsized":"2024-09-10T21:06:13.106675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.848743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105337+0000","last_change":"2024-09-10T21:06:11.772129+0000","last_active":"2024-09-10T21:06:13.105337+0000","last_peered":"2024-09-10T21:06:13.105337+0000","last_clean":"2024-09-10T21:06:13.105337+0000","last_became_active":"2024-09-10T21:06:11.771760+0000","last_became_peered":"2024-09-10T21:06:11.771760+0000","last_unstale":"2024-09-10T21:06:13.105337+0000","last_undegraded":"2024-09-10T21:06:13.105337+0000","last_fullsized":"2024-09-10T21:06:13.105337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:19.126960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107660+0000","last_change":"2024-09-10T21:06:07.740671+0000","last_active":"2024-09-10T21:06:13.107660+0000","last_peered":"2024-09-10T21:06:13.107660+0000","last_clean":"2024-09-10T21:06:13.107660+0000","last_became_active":"2024-09-10T21:06:07.740358+0000","last_became_peered":"2024-09-10T21:06:07.740358+0000","last_unstale":"2024-09-10T21:06:13.107660+0000","last_undegraded":"2024-09-10T21:06:13.107660+0000","last_fullsized":"2024-09-10T21:06:13.107660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:23.671822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751972+0000","last_change":"2024-09-10T21:06:06.733420+0000","last_active":"2024-09-10T21:06:12.751972+0000","last_peered":"2024-09-10T21:06:12.751972+0000","last_clean":"2024-09-10T21:06:12.751972+0000","last_became_active":"2024-09-10T21:06:06.733124+0000","last_became_peered":"2024-09-10T21:06:06.733124+0000","last_unstale":"2024-09-10T21:06:12.751972+0000","last_undegraded":"2024-09-10T21:06:12.751972+0000","last_fullsized":"2024-09-10T21:06:12.751972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.848743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754527+0000","last_change":"2024-09-10T21:06:11.765124+0000","last_active":"2024-09-10T21:06:12.754527+0000","last_peered":"2024-09-10T21:06:12.754527+0000","last_clean":"2024-09-10T21:06:12.754527+0000","last_became_active":"2024-09-10T21:06:11.764737+0000","last_became_peered":"2024-09-10T21:06:11.764737+0000","last_unstale":"2024-09-10T21:06:12.754527+0000","last_undegraded":"2024-09-10T21:06:12.754527+0000","last_fullsized":"2024-09-10T21:06:12.754527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:54.343216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105542+0000","last_change":"2024-09-10T21:06:07.722858+0000","last_active":"2024-09-10T21:06:13.105542+0000","last_peered":"2024-09-10T21:06:13.105542+0000","last_clean":"2024-09-10T21:06:13.105542+0000","last_became_active":"2024-09-10T21:06:07.722606+0000","last_became_peered":"2024-09-10T21:06:07.722606+0000","last_unstale":"2024-09-10T21:06:13.105542+0000","last_undegraded":"2024-09-10T21:06:13.105542+0000","last_fullsized":"2024-09-10T21:06:13.105542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:12.784568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105962+0000","last_change":"2024-09-10T21:06:06.732829+0000","last_active":"2024-09-10T21:06:13.105962+0000","last_peered":"2024-09-10T21:06:13.105962+0000","last_clean":"2024-09-10T21:06:13.105962+0000","last_became_active":"2024-09-10T21:06:06.732330+0000","last_became_peered":"2024-09-10T21:06:06.732330+0000","last_unstale":"2024-09-10T21:06:13.105962+0000","last_undegraded":"2024-09-10T21:06:13.105962+0000","last_fullsized":"2024-09-10T21:06:13.105962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:31.995655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096366+0000","last_change":"2024-09-10T21:06:11.770617+0000","last_active":"2024-09-10T21:06:13.096366+0000","last_peered":"2024-09-10T21:06:13.096366+0000","last_clean":"2024-09-10T21:06:13.096366+0000","last_became_active":"2024-09-10T21:06:11.770181+0000","last_became_peered":"2024-09-10T21:06:11.770181+0000","last_unstale":"2024-09-10T21:06:13.096366+0000","last_undegraded":"2024-09-10T21:06:13.096366+0000","last_fullsized":"2024-09-10T21:06:13.096366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:24.035068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754317+0000","last_change":"2024-09-10T21:06:07.736943+0000","last_active":"2024-09-10T21:06:12.754317+0000","last_peered":"2024-09-10T21:06:12.754317+0000","last_clean":"2024-09-10T21:06:12.754317+0000","last_became_active":"2024-09-10T21:06:07.734718+0000","last_became_peered":"2024-09-10T21:06:07.734718+0000","last_unstale":"2024-09-10T21:06:12.754317+0000","last_undegraded":"2024-09-10T21:06:12.754317+0000","last_fullsized":"2024-09-10T21:06:12.754317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751075+0000","last_change":"2024-09-10T21:06:06.721908+0000","last_active":"2024-09-10T21:06:12.751075+0000","last_peered":"2024-09-10T21:06:12.751075+0000","last_clean":"2024-09-10T21:06:12.751075+0000","last_became_active":"2024-09-10T21:06:06.721632+0000","last_became_peered":"2024-09-10T21:06:06.721632+0000","last_unstale":"2024-09-10T21:06:12.751075+0000","last_undegraded":"2024-09-10T21:06:12.751075+0000","last_fullsized":"2024-09-10T21:06:12.751075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:23.541255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096704+0000","last_change":"2024-09-10T21:06:11.778809+0000","last_active":"2024-09-10T21:06:13.096704+0000","last_peered":"2024-09-10T21:06:13.096704+0000","last_clean":"2024-09-10T21:06:13.096704+0000","last_became_active":"2024-09-10T21:06:11.773850+0000","last_became_peered":"2024-09-10T21:06:11.773850+0000","last_unstale":"2024-09-10T21:06:13.096704+0000","last_undegraded":"2024-09-10T21:06:13.096704+0000","last_fullsized":"2024-09-10T21:06:13.096704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:31.261505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105504+0000","last_change":"2024-09-10T21:06:07.748130+0000","last_active":"2024-09-10T21:06:13.105504+0000","last_peered":"2024-09-10T21:06:13.105504+0000","last_clean":"2024-09-10T21:06:13.105504+0000","last_became_active":"2024-09-10T21:06:07.747878+0000","last_became_peered":"2024-09-10T21:06:07.747878+0000","last_unstale":"2024-09-10T21:06:13.105504+0000","last_undegraded":"2024-09-10T21:06:13.105504+0000","last_fullsized":"2024-09-10T21:06:13.105504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:59.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105808+0000","last_change":"2024-09-10T21:06:06.726018+0000","last_active":"2024-09-10T21:06:13.105808+0000","last_peered":"2024-09-10T21:06:13.105808+0000","last_clean":"2024-09-10T21:06:13.105808+0000","last_became_active":"2024-09-10T21:06:06.725738+0000","last_became_peered":"2024-09-10T21:06:06.725738+0000","last_unstale":"2024-09-10T21:06:13.105808+0000","last_undegraded":"2024-09-10T21:06:13.105808+0000","last_fullsized":"2024-09-10T21:06:13.105808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:56.619842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105827+0000","last_change":"2024-09-10T21:06:11.765453+0000","last_active":"2024-09-10T21:06:13.105827+0000","last_peered":"2024-09-10T21:06:13.105827+0000","last_clean":"2024-09-10T21:06:13.105827+0000","last_became_active":"2024-09-10T21:06:11.764276+0000","last_became_peered":"2024-09-10T21:06:11.764276+0000","last_unstale":"2024-09-10T21:06:13.105827+0000","last_undegraded":"2024-09-10T21:06:13.105827+0000","last_fullsized":"2024-09-10T21:06:13.105827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:05.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106078+0000","last_change":"2024-09-10T21:06:07.735444+0000","last_active":"2024-09-10T21:06:13.106078+0000","last_peered":"2024-09-10T21:06:13.106078+0000","last_clean":"2024-09-10T21:06:13.106078+0000","last_became_active":"2024-09-10T21:06:07.734064+0000","last_became_peered":"2024-09-10T21:06:07.734064+0000","last_unstale":"2024-09-10T21:06:13.106078+0000","last_undegraded":"2024-09-10T21:06:13.106078+0000","last_fullsized":"2024-09-10T21:06:13.106078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:30.575576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755368+0000","last_change":"2024-09-10T21:06:06.735638+0000","last_active":"2024-09-10T21:06:12.755368+0000","last_peered":"2024-09-10T21:06:12.755368+0000","last_clean":"2024-09-10T21:06:12.755368+0000","last_became_active":"2024-09-10T21:06:06.735293+0000","last_became_peered":"2024-09-10T21:06:06.735293+0000","last_unstale":"2024-09-10T21:06:12.755368+0000","last_undegraded":"2024-09-10T21:06:12.755368+0000","last_fullsized":"2024-09-10T21:06:12.755368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:24.628433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106316+0000","last_change":"2024-09-10T21:06:11.764039+0000","last_active":"2024-09-10T21:06:13.106316+0000","last_peered":"2024-09-10T21:06:13.106316+0000","last_clean":"2024-09-10T21:06:13.106316+0000","last_became_active":"2024-09-10T21:06:11.763682+0000","last_became_peered":"2024-09-10T21:06:11.763682+0000","last_unstale":"2024-09-10T21:06:13.106316+0000","last_undegraded":"2024-09-10T21:06:13.106316+0000","last_fullsized":"2024-09-10T21:06:13.106316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:16.839314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751619+0000","last_change":"2024-09-10T21:06:07.738236+0000","last_active":"2024-09-10T21:06:12.751619+0000","last_peered":"2024-09-10T21:06:12.751619+0000","last_clean":"2024-09-10T21:06:12.751619+0000","last_became_active":"2024-09-10T21:06:07.737917+0000","last_became_peered":"2024-09-10T21:06:07.737917+0000","last_unstale":"2024-09-10T21:06:12.751619+0000","last_undegraded":"2024-09-10T21:06:12.751619+0000","last_fullsized":"2024-09-10T21:06:12.751619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:55.077742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:18.188883+0000","last_change":"2024-09-10T21:06:06.731715+0000","last_active":"2024-09-10T21:06:18.188883+0000","last_peered":"2024-09-10T21:06:18.188883+0000","last_clean":"2024-09-10T21:06:18.188883+0000","last_became_active":"2024-09-10T21:06:06.731420+0000","last_became_peered":"2024-09-10T21:06:06.731420+0000","last_unstale":"2024-09-10T21:06:18.188883+0000","last_undegraded":"2024-09-10T21:06:18.188883+0000","last_fullsized":"2024-09-10T21:06:18.188883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:33.538737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106144+0000","last_change":"2024-09-10T21:06:11.762541+0000","last_active":"2024-09-10T21:06:13.106144+0000","last_peered":"2024-09-10T21:06:13.106144+0000","last_clean":"2024-09-10T21:06:13.106144+0000","last_became_active":"2024-09-10T21:06:11.762102+0000","last_became_peered":"2024-09-10T21:06:11.762102+0000","last_unstale":"2024-09-10T21:06:13.106144+0000","last_undegraded":"2024-09-10T21:06:13.106144+0000","last_fullsized":"2024-09-10T21:06:13.106144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:59.114459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106254+0000","last_change":"2024-09-10T21:06:07.724490+0000","last_active":"2024-09-10T21:06:13.106254+0000","last_peered":"2024-09-10T21:06:13.106254+0000","last_clean":"2024-09-10T21:06:13.106254+0000","last_became_active":"2024-09-10T21:06:07.724157+0000","last_became_peered":"2024-09-10T21:06:07.724157+0000","last_unstale":"2024-09-10T21:06:13.106254+0000","last_undegraded":"2024-09-10T21:06:13.106254+0000","last_fullsized":"2024-09-10T21:06:13.106254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:23.477983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755368+0000","last_change":"2024-09-10T21:06:06.739360+0000","last_active":"2024-09-10T21:06:12.755368+0000","last_peered":"2024-09-10T21:06:12.755368+0000","last_clean":"2024-09-10T21:06:12.755368+0000","last_became_active":"2024-09-10T21:06:06.739136+0000","last_became_peered":"2024-09-10T21:06:06.739136+0000","last_unstale":"2024-09-10T21:06:12.755368+0000","last_undegraded":"2024-09-10T21:06:12.755368+0000","last_fullsized":"2024-09-10T21:06:12.755368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:42.131131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106640+0000","last_change":"2024-09-10T21:06:11.775845+0000","last_active":"2024-09-10T21:06:13.106640+0000","last_peered":"2024-09-10T21:06:13.106640+0000","last_clean":"2024-09-10T21:06:13.106640+0000","last_became_active":"2024-09-10T21:06:11.775460+0000","last_became_peered":"2024-09-10T21:06:11.775460+0000","last_unstale":"2024-09-10T21:06:13.106640+0000","last_undegraded":"2024-09-10T21:06:13.106640+0000","last_fullsized":"2024-09-10T21:06:13.106640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.820369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096792+0000","last_change":"2024-09-10T21:06:07.732030+0000","last_active":"2024-09-10T21:06:13.096792+0000","last_peered":"2024-09-10T21:06:13.096792+0000","last_clean":"2024-09-10T21:06:13.096792+0000","last_became_active":"2024-09-10T21:06:07.731726+0000","last_became_peered":"2024-09-10T21:06:07.731726+0000","last_unstale":"2024-09-10T21:06:13.096792+0000","last_undegraded":"2024-09-10T21:06:13.096792+0000","last_fullsized":"2024-09-10T21:06:13.096792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:51.701343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751643+0000","last_change":"2024-09-10T21:06:06.724643+0000","last_active":"2024-09-10T21:06:12.751643+0000","last_peered":"2024-09-10T21:06:12.751643+0000","last_clean":"2024-09-10T21:06:12.751643+0000","last_became_active":"2024-09-10T21:06:06.724348+0000","last_became_peered":"2024-09-10T21:06:06.724348+0000","last_unstale":"2024-09-10T21:06:12.751643+0000","last_undegraded":"2024-09-10T21:06:12.751643+0000","last_fullsized":"2024-09-10T21:06:12.751643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:14.047312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754380+0000","last_change":"2024-09-10T21:06:11.772999+0000","last_active":"2024-09-10T21:06:12.754380+0000","last_peered":"2024-09-10T21:06:12.754380+0000","last_clean":"2024-09-10T21:06:12.754380+0000","last_became_active":"2024-09-10T21:06:11.771544+0000","last_became_peered":"2024-09-10T21:06:11.771544+0000","last_unstale":"2024-09-10T21:06:12.754380+0000","last_undegraded":"2024-09-10T21:06:12.754380+0000","last_fullsized":"2024-09-10T21:06:12.754380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:10.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107606+0000","last_change":"2024-09-10T21:06:07.737581+0000","last_active":"2024-09-10T21:06:13.107606+0000","last_peered":"2024-09-10T21:06:13.107606+0000","last_clean":"2024-09-10T21:06:13.107606+0000","last_became_active":"2024-09-10T21:06:07.737246+0000","last_became_peered":"2024-09-10T21:06:07.737246+0000","last_unstale":"2024-09-10T21:06:13.107606+0000","last_undegraded":"2024-09-10T21:06:13.107606+0000","last_fullsized":"2024-09-10T21:06:13.107606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755005+0000","last_change":"2024-09-10T21:06:06.736661+0000","last_active":"2024-09-10T21:06:12.755005+0000","last_peered":"2024-09-10T21:06:12.755005+0000","last_clean":"2024-09-10T21:06:12.755005+0000","last_became_active":"2024-09-10T21:06:06.736356+0000","last_became_peered":"2024-09-10T21:06:06.736356+0000","last_unstale":"2024-09-10T21:06:12.755005+0000","last_undegraded":"2024-09-10T21:06:12.755005+0000","last_fullsized":"2024-09-10T21:06:12.755005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:20.425789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105911+0000","last_change":"2024-09-10T21:06:11.760467+0000","last_active":"2024-09-10T21:06:13.105911+0000","last_peered":"2024-09-10T21:06:13.105911+0000","last_clean":"2024-09-10T21:06:13.105911+0000","last_became_active":"2024-09-10T21:06:11.760101+0000","last_became_peered":"2024-09-10T21:06:11.760101+0000","last_unstale":"2024-09-10T21:06:13.105911+0000","last_undegraded":"2024-09-10T21:06:13.105911+0000","last_fullsized":"2024-09-10T21:06:13.105911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:03.280132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106059+0000","last_change":"2024-09-10T21:06:11.763190+0000","last_active":"2024-09-10T21:06:13.106059+0000","last_peered":"2024-09-10T21:06:13.106059+0000","last_clean":"2024-09-10T21:06:13.106059+0000","last_became_active":"2024-09-10T21:06:11.758968+0000","last_became_peered":"2024-09-10T21:06:11.758968+0000","last_unstale":"2024-09-10T21:06:13.106059+0000","last_undegraded":"2024-09-10T21:06:13.106059+0000","last_fullsized":"2024-09-10T21:06:13.106059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:16.821284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106076+0000","last_change":"2024-09-10T21:06:07.747586+0000","last_active":"2024-09-10T21:06:13.106076+0000","last_peered":"2024-09-10T21:06:13.106076+0000","last_clean":"2024-09-10T21:06:13.106076+0000","last_became_active":"2024-09-10T21:06:07.745029+0000","last_became_peered":"2024-09-10T21:06:07.745029+0000","last_unstale":"2024-09-10T21:06:13.106076+0000","last_undegraded":"2024-09-10T21:06:13.106076+0000","last_fullsized":"2024-09-10T21:06:13.106076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.948769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105798+0000","last_change":"2024-09-10T21:06:06.719711+0000","last_active":"2024-09-10T21:06:13.105798+0000","last_peered":"2024-09-10T21:06:13.105798+0000","last_clean":"2024-09-10T21:06:13.105798+0000","last_became_active":"2024-09-10T21:06:06.719461+0000","last_became_peered":"2024-09-10T21:06:06.719461+0000","last_unstale":"2024-09-10T21:06:13.105798+0000","last_undegraded":"2024-09-10T21:06:13.105798+0000","last_fullsized":"2024-09-10T21:06:13.105798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:05.884744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106296+0000","last_change":"2024-09-10T21:06:11.763903+0000","last_active":"2024-09-10T21:06:13.106296+0000","last_peered":"2024-09-10T21:06:13.106296+0000","last_clean":"2024-09-10T21:06:13.106296+0000","last_became_active":"2024-09-10T21:06:11.763549+0000","last_became_peered":"2024-09-10T21:06:11.763549+0000","last_unstale":"2024-09-10T21:06:13.106296+0000","last_undegraded":"2024-09-10T21:06:13.106296+0000","last_fullsized":"2024-09-10T21:06:13.106296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:28.790789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095775+0000","last_change":"2024-09-10T21:06:07.736045+0000","last_active":"2024-09-10T21:06:13.095775+0000","last_peered":"2024-09-10T21:06:13.095775+0000","last_clean":"2024-09-10T21:06:13.095775+0000","last_became_active":"2024-09-10T21:06:07.733458+0000","last_became_peered":"2024-09-10T21:06:07.733458+0000","last_unstale":"2024-09-10T21:06:13.095775+0000","last_undegraded":"2024-09-10T21:06:13.095775+0000","last_fullsized":"2024-09-10T21:06:13.095775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:31.627773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105575+0000","last_change":"2024-09-10T21:06:06.729442+0000","last_active":"2024-09-10T21:06:13.105575+0000","last_peered":"2024-09-10T21:06:13.105575+0000","last_clean":"2024-09-10T21:06:13.105575+0000","last_became_active":"2024-09-10T21:06:06.729045+0000","last_became_peered":"2024-09-10T21:06:06.729045+0000","last_unstale":"2024-09-10T21:06:13.105575+0000","last_undegraded":"2024-09-10T21:06:13.105575+0000","last_fullsized":"2024-09-10T21:06:13.105575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:35.821653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105776+0000","last_change":"2024-09-10T21:06:06.728511+0000","last_active":"2024-09-10T21:06:13.105776+0000","last_peered":"2024-09-10T21:06:13.105776+0000","last_clean":"2024-09-10T21:06:13.105776+0000","last_became_active":"2024-09-10T21:06:06.728200+0000","last_became_peered":"2024-09-10T21:06:06.728200+0000","last_unstale":"2024-09-10T21:06:13.105776+0000","last_undegraded":"2024-09-10T21:06:13.105776+0000","last_fullsized":"2024-09-10T21:06:13.105776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:30.893513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106622+0000","last_change":"2024-09-10T21:06:07.750023+0000","last_active":"2024-09-10T21:06:13.106622+0000","last_peered":"2024-09-10T21:06:13.106622+0000","last_clean":"2024-09-10T21:06:13.106622+0000","last_became_active":"2024-09-10T21:06:07.749735+0000","last_became_peered":"2024-09-10T21:06:07.749735+0000","last_unstale":"2024-09-10T21:06:13.106622+0000","last_undegraded":"2024-09-10T21:06:13.106622+0000","last_fullsized":"2024-09-10T21:06:13.106622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:09.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106429+0000","last_change":"2024-09-10T21:06:11.764282+0000","last_active":"2024-09-10T21:06:13.106429+0000","last_peered":"2024-09-10T21:06:13.106429+0000","last_clean":"2024-09-10T21:06:13.106429+0000","last_became_active":"2024-09-10T21:06:11.763052+0000","last_became_peered":"2024-09-10T21:06:11.763052+0000","last_unstale":"2024-09-10T21:06:13.106429+0000","last_undegraded":"2024-09-10T21:06:13.106429+0000","last_fullsized":"2024-09-10T21:06:13.106429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:49.419399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096049+0000","last_change":"2024-09-10T21:06:06.724502+0000","last_active":"2024-09-10T21:06:13.096049+0000","last_peered":"2024-09-10T21:06:13.096049+0000","last_clean":"2024-09-10T21:06:13.096049+0000","last_became_active":"2024-09-10T21:06:06.723257+0000","last_became_peered":"2024-09-10T21:06:06.723257+0000","last_unstale":"2024-09-10T21:06:13.096049+0000","last_undegraded":"2024-09-10T21:06:13.096049+0000","last_fullsized":"2024-09-10T21:06:13.096049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:33.839048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754544+0000","last_change":"2024-09-10T21:06:07.731233+0000","last_active":"2024-09-10T21:06:12.754544+0000","last_peered":"2024-09-10T21:06:12.754544+0000","last_clean":"2024-09-10T21:06:12.754544+0000","last_became_active":"2024-09-10T21:06:07.730548+0000","last_became_peered":"2024-09-10T21:06:07.730548+0000","last_unstale":"2024-09-10T21:06:12.754544+0000","last_undegraded":"2024-09-10T21:06:12.754544+0000","last_fullsized":"2024-09-10T21:06:12.754544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755250+0000","last_change":"2024-09-10T21:06:11.774785+0000","last_active":"2024-09-10T21:06:12.755250+0000","last_peered":"2024-09-10T21:06:12.755250+0000","last_clean":"2024-09-10T21:06:12.755250+0000","last_became_active":"2024-09-10T21:06:11.774346+0000","last_became_peered":"2024-09-10T21:06:11.774346+0000","last_unstale":"2024-09-10T21:06:12.755250+0000","last_undegraded":"2024-09-10T21:06:12.755250+0000","last_fullsized":"2024-09-10T21:06:12.755250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:02.110289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105230+0000","last_change":"2024-09-10T21:06:07.740108+0000","last_active":"2024-09-10T21:06:13.105230+0000","last_peered":"2024-09-10T21:06:13.105230+0000","last_clean":"2024-09-10T21:06:13.105230+0000","last_became_active":"2024-09-10T21:06:07.739794+0000","last_became_peered":"2024-09-10T21:06:07.739794+0000","last_unstale":"2024-09-10T21:06:13.105230+0000","last_undegraded":"2024-09-10T21:06:13.105230+0000","last_fullsized":"2024-09-10T21:06:13.105230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754458+0000","last_change":"2024-09-10T21:06:07.733770+0000","last_active":"2024-09-10T21:06:12.754458+0000","last_peered":"2024-09-10T21:06:12.754458+0000","last_clean":"2024-09-10T21:06:12.754458+0000","last_became_active":"2024-09-10T21:06:07.733519+0000","last_became_peered":"2024-09-10T21:06:07.733519+0000","last_unstale":"2024-09-10T21:06:12.754458+0000","last_undegraded":"2024-09-10T21:06:12.754458+0000","last_fullsized":"2024-09-10T21:06:12.754458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105599+0000","last_change":"2024-09-10T21:06:07.722573+0000","last_active":"2024-09-10T21:06:13.105599+0000","last_peered":"2024-09-10T21:06:13.105599+0000","last_clean":"2024-09-10T21:06:13.105599+0000","last_became_active":"2024-09-10T21:06:07.722291+0000","last_became_peered":"2024-09-10T21:06:07.722291+0000","last_unstale":"2024-09-10T21:06:13.105599+0000","last_undegraded":"2024-09-10T21:06:13.105599+0000","last_fullsized":"2024-09-10T21:06:13.105599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:24.676940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095949+0000","last_change":"2024-09-10T21:06:07.725057+0000","last_active":"2024-09-10T21:06:13.095949+0000","last_peered":"2024-09-10T21:06:13.095949+0000","last_clean":"2024-09-10T21:06:13.095949+0000","last_became_active":"2024-09-10T21:06:07.724777+0000","last_became_peered":"2024-09-10T21:06:07.724777+0000","last_unstale":"2024-09-10T21:06:13.095949+0000","last_undegraded":"2024-09-10T21:06:13.095949+0000","last_fullsized":"2024-09-10T21:06:13.095949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:05.565224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106908+0000","last_change":"2024-09-10T21:06:07.735771+0000","last_active":"2024-09-10T21:06:13.106908+0000","last_peered":"2024-09-10T21:06:13.106908+0000","last_clean":"2024-09-10T21:06:13.106908+0000","last_became_active":"2024-09-10T21:06:07.735447+0000","last_became_peered":"2024-09-10T21:06:07.735447+0000","last_unstale":"2024-09-10T21:06:13.106908+0000","last_undegraded":"2024-09-10T21:06:13.106908+0000","last_fullsized":"2024-09-10T21:06:13.106908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:21.629321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107117+0000","last_change":"2024-09-10T21:06:07.726407+0000","last_active":"2024-09-10T21:06:13.107117+0000","last_peered":"2024-09-10T21:06:13.107117+0000","last_clean":"2024-09-10T21:06:13.107117+0000","last_became_active":"2024-09-10T21:06:07.726061+0000","last_became_peered":"2024-09-10T21:06:07.726061+0000","last_unstale":"2024-09-10T21:06:13.107117+0000","last_undegraded":"2024-09-10T21:06:13.107117+0000","last_fullsized":"2024-09-10T21:06:13.107117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:23.671822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107518+0000","last_change":"2024-09-10T21:06:07.737552+0000","last_active":"2024-09-10T21:06:13.107518+0000","last_peered":"2024-09-10T21:06:13.107518+0000","last_clean":"2024-09-10T21:06:13.107518+0000","last_became_active":"2024-09-10T21:06:07.737253+0000","last_became_peered":"2024-09-10T21:06:07.737253+0000","last_unstale":"2024-09-10T21:06:13.107518+0000","last_undegraded":"2024-09-10T21:06:13.107518+0000","last_fullsized":"2024-09-10T21:06:13.107518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:43.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096602+0000","last_change":"2024-09-10T21:06:07.738429+0000","last_active":"2024-09-10T21:06:13.096602+0000","last_peered":"2024-09-10T21:06:13.096602+0000","last_clean":"2024-09-10T21:06:13.096602+0000","last_became_active":"2024-09-10T21:06:07.736750+0000","last_became_peered":"2024-09-10T21:06:07.736750+0000","last_unstale":"2024-09-10T21:06:13.096602+0000","last_undegraded":"2024-09-10T21:06:13.096602+0000","last_fullsized":"2024-09-10T21:06:13.096602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:15.172285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105703+0000","last_change":"2024-09-10T21:06:07.727750+0000","last_active":"2024-09-10T21:06:13.105703+0000","last_peered":"2024-09-10T21:06:13.105703+0000","last_clean":"2024-09-10T21:06:13.105703+0000","last_became_active":"2024-09-10T21:06:07.727492+0000","last_became_peered":"2024-09-10T21:06:07.727492+0000","last_unstale":"2024-09-10T21:06:13.105703+0000","last_undegraded":"2024-09-10T21:06:13.105703+0000","last_fullsized":"2024-09-10T21:06:13.105703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:45.382683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095636+0000","last_change":"2024-09-10T21:06:07.734497+0000","last_active":"2024-09-10T21:06:13.095636+0000","last_peered":"2024-09-10T21:06:13.095636+0000","last_clean":"2024-09-10T21:06:13.095636+0000","last_became_active":"2024-09-10T21:06:07.731837+0000","last_became_peered":"2024-09-10T21:06:07.731837+0000","last_unstale":"2024-09-10T21:06:13.095636+0000","last_undegraded":"2024-09-10T21:06:13.095636+0000","last_fullsized":"2024-09-10T21:06:13.095636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:10.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754456+0000","last_change":"2024-09-10T21:06:07.731385+0000","last_active":"2024-09-10T21:06:12.754456+0000","last_peered":"2024-09-10T21:06:12.754456+0000","last_clean":"2024-09-10T21:06:12.754456+0000","last_became_active":"2024-09-10T21:06:07.730952+0000","last_became_peered":"2024-09-10T21:06:07.730952+0000","last_unstale":"2024-09-10T21:06:12.754456+0000","last_undegraded":"2024-09-10T21:06:12.754456+0000","last_fullsized":"2024-09-10T21:06:12.754456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106509+0000","last_change":"2024-09-10T21:06:07.743829+0000","last_active":"2024-09-10T21:06:13.106509+0000","last_peered":"2024-09-10T21:06:13.106509+0000","last_clean":"2024-09-10T21:06:13.106509+0000","last_became_active":"2024-09-10T21:06:07.743556+0000","last_became_peered":"2024-09-10T21:06:07.743556+0000","last_unstale":"2024-09-10T21:06:13.106509+0000","last_undegraded":"2024-09-10T21:06:13.106509+0000","last_fullsized":"2024-09-10T21:06:13.106509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:58.073572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751609+0000","last_change":"2024-09-10T21:06:07.731428+0000","last_active":"2024-09-10T21:06:12.751609+0000","last_peered":"2024-09-10T21:06:12.751609+0000","last_clean":"2024-09-10T21:06:12.751609+0000","last_became_active":"2024-09-10T21:06:07.731151+0000","last_became_peered":"2024-09-10T21:06:07.731151+0000","last_unstale":"2024-09-10T21:06:12.751609+0000","last_undegraded":"2024-09-10T21:06:12.751609+0000","last_fullsized":"2024-09-10T21:06:12.751609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:10.318478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106834+0000","last_change":"2024-09-10T21:06:07.729264+0000","last_active":"2024-09-10T21:06:13.106834+0000","last_peered":"2024-09-10T21:06:13.106834+0000","last_clean":"2024-09-10T21:06:13.106834+0000","last_became_active":"2024-09-10T21:06:07.729001+0000","last_became_peered":"2024-09-10T21:06:07.729001+0000","last_unstale":"2024-09-10T21:06:13.106834+0000","last_undegraded":"2024-09-10T21:06:13.106834+0000","last_fullsized":"2024-09-10T21:06:13.106834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:13.030165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754965+0000","last_change":"2024-09-10T21:06:07.729035+0000","last_active":"2024-09-10T21:06:12.754965+0000","last_peered":"2024-09-10T21:06:12.754965+0000","last_clean":"2024-09-10T21:06:12.754965+0000","last_became_active":"2024-09-10T21:06:07.728726+0000","last_became_peered":"2024-09-10T21:06:07.728726+0000","last_unstale":"2024-09-10T21:06:12.754965+0000","last_undegraded":"2024-09-10T21:06:12.754965+0000","last_fullsized":"2024-09-10T21:06:12.754965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107040+0000","last_change":"2024-09-10T21:06:07.727552+0000","last_active":"2024-09-10T21:06:13.107040+0000","last_peered":"2024-09-10T21:06:13.107040+0000","last_clean":"2024-09-10T21:06:13.107040+0000","last_became_active":"2024-09-10T21:06:07.727247+0000","last_became_peered":"2024-09-10T21:06:07.727247+0000","last_unstale":"2024-09-10T21:06:13.107040+0000","last_undegraded":"2024-09-10T21:06:13.107040+0000","last_fullsized":"2024-09-10T21:06:13.107040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:17.742182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105603+0000","last_change":"2024-09-10T21:06:07.724043+0000","last_active":"2024-09-10T21:06:13.105603+0000","last_peered":"2024-09-10T21:06:13.105603+0000","last_clean":"2024-09-10T21:06:13.105603+0000","last_became_active":"2024-09-10T21:06:07.723760+0000","last_became_peered":"2024-09-10T21:06:07.723760+0000","last_unstale":"2024-09-10T21:06:13.105603+0000","last_undegraded":"2024-09-10T21:06:13.105603+0000","last_fullsized":"2024-09-10T21:06:13.105603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:31.704899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095465+0000","last_change":"2024-09-10T21:06:07.731993+0000","last_active":"2024-09-10T21:06:13.095465+0000","last_peered":"2024-09-10T21:06:13.095465+0000","last_clean":"2024-09-10T21:06:13.095465+0000","last_became_active":"2024-09-10T21:06:07.728201+0000","last_became_peered":"2024-09-10T21:06:07.728201+0000","last_unstale":"2024-09-10T21:06:13.095465+0000","last_undegraded":"2024-09-10T21:06:13.095465+0000","last_fullsized":"2024-09-10T21:06:13.095465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:37.030681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105964+0000","last_change":"2024-09-10T21:06:07.726441+0000","last_active":"2024-09-10T21:06:13.105964+0000","last_peered":"2024-09-10T21:06:13.105964+0000","last_clean":"2024-09-10T21:06:13.105964+0000","last_became_active":"2024-09-10T21:06:07.726129+0000","last_became_peered":"2024-09-10T21:06:07.726129+0000","last_unstale":"2024-09-10T21:06:13.105964+0000","last_undegraded":"2024-09-10T21:06:13.105964+0000","last_fullsized":"2024-09-10T21:06:13.105964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:50.280191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106522+0000","last_change":"2024-09-10T21:06:07.745674+0000","last_active":"2024-09-10T21:06:13.106522+0000","last_peered":"2024-09-10T21:06:13.106522+0000","last_clean":"2024-09-10T21:06:13.106522+0000","last_became_active":"2024-09-10T21:06:07.745377+0000","last_became_peered":"2024-09-10T21:06:07.745377+0000","last_unstale":"2024-09-10T21:06:13.106522+0000","last_undegraded":"2024-09-10T21:06:13.106522+0000","last_fullsized":"2024-09-10T21:06:13.106522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:58.465613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751580+0000","last_change":"2024-09-10T21:06:07.742353+0000","last_active":"2024-09-10T21:06:12.751580+0000","last_peered":"2024-09-10T21:06:12.751580+0000","last_clean":"2024-09-10T21:06:12.751580+0000","last_became_active":"2024-09-10T21:06:07.741768+0000","last_became_peered":"2024-09-10T21:06:07.741768+0000","last_unstale":"2024-09-10T21:06:12.751580+0000","last_undegraded":"2024-09-10T21:06:12.751580+0000","last_fullsized":"2024-09-10T21:06:12.751580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:21.303563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751664+0000","last_change":"2024-09-10T21:06:07.750182+0000","last_active":"2024-09-10T21:06:12.751664+0000","last_peered":"2024-09-10T21:06:12.751664+0000","last_clean":"2024-09-10T21:06:12.751664+0000","last_became_active":"2024-09-10T21:06:07.749545+0000","last_became_peered":"2024-09-10T21:06:07.749545+0000","last_unstale":"2024-09-10T21:06:12.751664+0000","last_undegraded":"2024-09-10T21:06:12.751664+0000","last_fullsized":"2024-09-10T21:06:12.751664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:01.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751610+0000","last_change":"2024-09-10T21:06:07.744262+0000","last_active":"2024-09-10T21:06:12.751610+0000","last_peered":"2024-09-10T21:06:12.751610+0000","last_clean":"2024-09-10T21:06:12.751610+0000","last_became_active":"2024-09-10T21:06:07.732781+0000","last_became_peered":"2024-09-10T21:06:07.732781+0000","last_unstale":"2024-09-10T21:06:12.751610+0000","last_undegraded":"2024-09-10T21:06:12.751610+0000","last_fullsized":"2024-09-10T21:06:12.751610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:58.650133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754980+0000","last_change":"2024-09-10T21:06:07.733975+0000","last_active":"2024-09-10T21:06:12.754980+0000","last_peered":"2024-09-10T21:06:12.754980+0000","last_clean":"2024-09-10T21:06:12.754980+0000","last_became_active":"2024-09-10T21:06:07.733715+0000","last_became_peered":"2024-09-10T21:06:07.733715+0000","last_unstale":"2024-09-10T21:06:12.754980+0000","last_undegraded":"2024-09-10T21:06:12.754980+0000","last_fullsized":"2024-09-10T21:06:12.754980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095474+0000","last_change":"2024-09-10T21:06:07.739522+0000","last_active":"2024-09-10T21:06:13.095474+0000","last_peered":"2024-09-10T21:06:13.095474+0000","last_clean":"2024-09-10T21:06:13.095474+0000","last_became_active":"2024-09-10T21:06:07.739162+0000","last_became_peered":"2024-09-10T21:06:07.739162+0000","last_unstale":"2024-09-10T21:06:13.095474+0000","last_undegraded":"2024-09-10T21:06:13.095474+0000","last_fullsized":"2024-09-10T21:06:13.095474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:03.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751051+0000","last_change":"2024-09-10T21:06:07.728083+0000","last_active":"2024-09-10T21:06:12.751051+0000","last_peered":"2024-09-10T21:06:12.751051+0000","last_clean":"2024-09-10T21:06:12.751051+0000","last_became_active":"2024-09-10T21:06:07.727804+0000","last_became_peered":"2024-09-10T21:06:07.727804+0000","last_unstale":"2024-09-10T21:06:12.751051+0000","last_undegraded":"2024-09-10T21:06:12.751051+0000","last_fullsized":"2024-09-10T21:06:12.751051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:04.725083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106825+0000","last_change":"2024-09-10T21:06:07.741270+0000","last_active":"2024-09-10T21:06:13.106825+0000","last_peered":"2024-09-10T21:06:13.106825+0000","last_clean":"2024-09-10T21:06:13.106825+0000","last_became_active":"2024-09-10T21:06:07.740584+0000","last_became_peered":"2024-09-10T21:06:07.740584+0000","last_unstale":"2024-09-10T21:06:13.106825+0000","last_undegraded":"2024-09-10T21:06:13.106825+0000","last_fullsized":"2024-09-10T21:06:13.106825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:52.489450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751331+0000","last_change":"2024-09-10T21:06:07.745169+0000","last_active":"2024-09-10T21:06:12.751331+0000","last_peered":"2024-09-10T21:06:12.751331+0000","last_clean":"2024-09-10T21:06:12.751331+0000","last_became_active":"2024-09-10T21:06:07.744772+0000","last_became_peered":"2024-09-10T21:06:07.744772+0000","last_unstale":"2024-09-10T21:06:12.751331+0000","last_undegraded":"2024-09-10T21:06:12.751331+0000","last_fullsized":"2024-09-10T21:06:12.751331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:03.406166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106982+0000","last_change":"2024-09-10T21:06:07.736065+0000","last_active":"2024-09-10T21:06:13.106982+0000","last_peered":"2024-09-10T21:06:13.106982+0000","last_clean":"2024-09-10T21:06:13.106982+0000","last_became_active":"2024-09-10T21:06:07.735732+0000","last_became_peered":"2024-09-10T21:06:07.735732+0000","last_unstale":"2024-09-10T21:06:13.106982+0000","last_undegraded":"2024-09-10T21:06:13.106982+0000","last_fullsized":"2024-09-10T21:06:13.106982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095910+0000","last_change":"2024-09-10T21:06:07.739765+0000","last_active":"2024-09-10T21:06:13.095910+0000","last_peered":"2024-09-10T21:06:13.095910+0000","last_clean":"2024-09-10T21:06:13.095910+0000","last_became_active":"2024-09-10T21:06:07.739457+0000","last_became_peered":"2024-09-10T21:06:07.739457+0000","last_unstale":"2024-09-10T21:06:13.095910+0000","last_undegraded":"2024-09-10T21:06:13.095910+0000","last_fullsized":"2024-09-10T21:06:13.095910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:58.818281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096192+0000","last_change":"2024-09-10T21:06:07.735873+0000","last_active":"2024-09-10T21:06:13.096192+0000","last_peered":"2024-09-10T21:06:13.096192+0000","last_clean":"2024-09-10T21:06:13.096192+0000","last_became_active":"2024-09-10T21:06:07.735589+0000","last_became_peered":"2024-09-10T21:06:07.735589+0000","last_unstale":"2024-09-10T21:06:13.096192+0000","last_undegraded":"2024-09-10T21:06:13.096192+0000","last_fullsized":"2024-09-10T21:06:13.096192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:26.970429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751832+0000","last_change":"2024-09-10T21:06:07.748933+0000","last_active":"2024-09-10T21:06:12.751832+0000","last_peered":"2024-09-10T21:06:12.751832+0000","last_clean":"2024-09-10T21:06:12.751832+0000","last_became_active":"2024-09-10T21:06:07.748659+0000","last_became_peered":"2024-09-10T21:06:07.748659+0000","last_unstale":"2024-09-10T21:06:12.751832+0000","last_undegraded":"2024-09-10T21:06:12.751832+0000","last_fullsized":"2024-09-10T21:06:12.751832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:26.789804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":114938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":112626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:06:25.223 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T21:06:25.223 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T21:06:25.223 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T21:06:25.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.413+0000 7f9e2e000640 1 -- 172.21.15.100:0/2956757420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e2815c750 msgr2=0x7f9e280cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.413+0000 7f9e2e000640 1 --2- 172.21.15.100:0/2956757420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e2815c750 0x7f9e280cf780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005fd0 tx=0x7f9e2002a820 comp rx=0 tx=0).stop 2024-09-10T21:06:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.413+0000 7f9e2e000640 1 -- 172.21.15.100:0/2956757420 shutdown_connections 2024-09-10T21:06:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.413+0000 7f9e2e000640 1 --2- 172.21.15.100:0/2956757420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e2815c750 0x7f9e280cf780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.413+0000 7f9e2e000640 1 --2- 172.21.15.100:0/2956757420 >> v2:172.21.15.130:3300/0 conn(0x7f9e2815b680 0x7f9e2815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.413+0000 7f9e2e000640 1 -- 172.21.15.100:0/2956757420 >> 172.21.15.100:0/2956757420 conn(0x7f9e2806cb50 msgr2=0x7f9e2806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.413+0000 7f9e2e000640 1 -- 172.21.15.100:0/2956757420 shutdown_connections 2024-09-10T21:06:25.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.413+0000 7f9e2e000640 1 -- 172.21.15.100:0/2956757420 wait complete. 2024-09-10T21:06:25.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.414+0000 7f9e2e000640 1 Processor -- start 2024-09-10T21:06:25.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.414+0000 7f9e2e000640 1 -- start start 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.415+0000 7f9e2e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e280741e0 0x7f9e280a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.415+0000 7f9e2e000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e2815b680 0x7f9e28158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.415+0000 7f9e2e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2815c750 0x7f9e281592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.415+0000 7f9e2e000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e280b2860 con 0x7f9e2815c750 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.415+0000 7f9e2e000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9e280b29e0 con 0x7f9e280741e0 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.415+0000 7f9e2e000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9e280b2b60 con 0x7f9e2815b680 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2815c750 0x7f9e281592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2815c750 0x7f9e281592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34858/0 (socket says 172.21.15.100:34858) 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 -- 172.21.15.100:0/3607765310 learned_addr learned my addr 172.21.15.100:0/3607765310 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:25.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27400640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e280741e0 0x7f9e280a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e1ea00640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e2815b680 0x7f9e28158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 -- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e2815b680 msgr2=0x7f9e28158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e2815b680 0x7f9e28158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 -- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e280741e0 msgr2=0x7f9e280a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e280741e0 0x7f9e280a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 -- 172.21.15.100:0/3607765310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e280b0130 con 0x7f9e2815c750 2024-09-10T21:06:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27400640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e280741e0 0x7f9e280a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:25.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.416+0000 7f9e27e00640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2815c750 0x7f9e281592d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9e20035040 tx=0x7f9e20032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.417+0000 7f9e1fe00640 1 -- 172.21.15.100:0/3607765310 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20037040 con 0x7f9e2815c750 2024-09-10T21:06:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.417+0000 7f9e1fe00640 1 -- 172.21.15.100:0/3607765310 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e20042070 con 0x7f9e2815c750 2024-09-10T21:06:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.417+0000 7f9e1fe00640 1 -- 172.21.15.100:0/3607765310 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20003e60 con 0x7f9e2815c750 2024-09-10T21:06:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.417+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e280b0410 con 0x7f9e2815c750 2024-09-10T21:06:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.417+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e280b09d0 con 0x7f9e2815c750 2024-09-10T21:06:25.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.418+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e280b3010 con 0x7f9e2815c750 2024-09-10T21:06:25.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.419+0000 7f9e1fe00640 1 -- 172.21.15.100:0/3607765310 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9e2003a030 con 0x7f9e2815c750 2024-09-10T21:06:25.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.420+0000 7f9e1fe00640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9e04077f70 0x7f9e0407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.420+0000 7f9e1fe00640 1 -- 172.21.15.100:0/3607765310 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9e200ba9c0 con 0x7f9e2815c750 2024-09-10T21:06:25.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.420+0000 7f9e27400640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9e04077f70 0x7f9e0407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.421+0000 7f9e27400640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9e04077f70 0x7f9e0407a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e280cc0a0 tx=0x7f9e18005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:25.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.424+0000 7f9e1fe00640 1 -- 172.21.15.100:0/3607765310 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9e20083170 con 0x7f9e2815c750 2024-09-10T21:06:25.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.606+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f9e28154a60 con 0x7f9e2815c750 2024-09-10T21:06:25.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.607+0000 7f9e1fe00640 1 -- 172.21.15.100:0/3607765310 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f9e20082a70 con 0x7f9e2815c750 2024-09-10T21:06:25.611 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:25.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9e04077f70 msgr2=0x7f9e0407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9e04077f70 0x7f9e0407a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e280cc0a0 tx=0x7f9e18005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:25.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2815c750 msgr2=0x7f9e281592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2815c750 0x7f9e281592d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9e20035040 tx=0x7f9e20032c60 comp rx=0 tx=0).stop 2024-09-10T21:06:25.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 shutdown_connections 2024-09-10T21:06:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2815c750 0x7f9e281592d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e2815b680 0x7f9e28158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9e04077f70 0x7f9e0407a430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 --2- 172.21.15.100:0/3607765310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e280741e0 0x7f9e280a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.609+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 >> 172.21.15.100:0/3607765310 conn(0x7f9e2806cb50 msgr2=0x7f9e2806cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.610+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 shutdown_connections 2024-09-10T21:06:25.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.610+0000 7f9e2e000640 1 -- 172.21.15.100:0/3607765310 wait complete. 2024-09-10T21:06:25.630 INFO:teuthology.orchestra.run.smithi100.stdout:[{"version":27,"timestamp":"2024-09-10T21:05:55.266127+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"3572.669398"}]}] 2024-09-10T21:06:25.630 INFO:tasks.ceph_manager:config epoch is 27 2024-09-10T21:06:25.631 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T21:06:25.631 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T21:06:25.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T21:06:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.783+0000 7f9a37600640 1 -- 172.21.15.100:0/3497632974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3015b4d0 msgr2=0x7f9a3015ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.783+0000 7f9a37600640 1 --2- 172.21.15.100:0/3497632974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3015b4d0 0x7f9a3015ea60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009860 tx=0x7f9a2402a5d0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.783+0000 7f9a37600640 1 -- 172.21.15.100:0/3497632974 shutdown_connections 2024-09-10T21:06:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.783+0000 7f9a37600640 1 --2- 172.21.15.100:0/3497632974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3015b4d0 0x7f9a3015ea60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.783+0000 7f9a37600640 1 -- 172.21.15.100:0/3497632974 >> 172.21.15.100:0/3497632974 conn(0x7f9a3006cb50 msgr2=0x7f9a3006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.783+0000 7f9a37600640 1 -- 172.21.15.100:0/3497632974 shutdown_connections 2024-09-10T21:06:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.783+0000 7f9a37600640 1 -- 172.21.15.100:0/3497632974 wait complete. 2024-09-10T21:06:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.784+0000 7f9a37600640 1 Processor -- start 2024-09-10T21:06:25.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.785+0000 7f9a37600640 1 -- start start 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.785+0000 7f9a37600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3006eb60 0x7f9a30145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.785+0000 7f9a37600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a300cf810 0x7f9a30146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.785+0000 7f9a37600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a3015b4d0 0x7f9a301ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.785+0000 7f9a37600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a300b3120 con 0x7f9a3006eb60 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.785+0000 7f9a37600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3006f430 con 0x7f9a3015b4d0 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.785+0000 7f9a37600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9a300b32a0 con 0x7f9a300cf810 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3006eb60 0x7f9a30145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3006eb60 0x7f9a30145440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34872/0 (socket says 172.21.15.100:34872) 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 -- 172.21.15.100:0/3535794560 learned_addr learned my addr 172.21.15.100:0/3535794560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a2fe00640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a300cf810 0x7f9a30146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 -- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a300cf810 msgr2=0x7f9a30146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a300cf810 0x7f9a30146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 -- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a3015b4d0 msgr2=0x7f9a301ea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a3015b4d0 0x7f9a301ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 -- 172.21.15.100:0/3535794560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a30145b40 con 0x7f9a3006eb60 2024-09-10T21:06:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a2fe00640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a300cf810 0x7f9a30146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.786+0000 7f9a34c00640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3006eb60 0x7f9a30145440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009780 tx=0x7f9a24033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.787+0000 7f9a2cc00640 1 -- 172.21.15.100:0/3535794560 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24031d60 con 0x7f9a3006eb60 2024-09-10T21:06:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.787+0000 7f9a2cc00640 1 -- 172.21.15.100:0/3535794560 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a24005020 con 0x7f9a3006eb60 2024-09-10T21:06:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.787+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a30145e20 con 0x7f9a3006eb60 2024-09-10T21:06:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.787+0000 7f9a2cc00640 1 -- 172.21.15.100:0/3535794560 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24005450 con 0x7f9a3006eb60 2024-09-10T21:06:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.787+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a301463e0 con 0x7f9a3006eb60 2024-09-10T21:06:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.788+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3015ea60 con 0x7f9a3006eb60 2024-09-10T21:06:25.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.789+0000 7f9a2cc00640 1 -- 172.21.15.100:0/3535794560 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9a240047a0 con 0x7f9a3006eb60 2024-09-10T21:06:25.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.790+0000 7f9a2cc00640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9a10077f70 0x7f9a1007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:25.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.790+0000 7f9a2cc00640 1 -- 172.21.15.100:0/3535794560 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9a240bb150 con 0x7f9a3006eb60 2024-09-10T21:06:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.790+0000 7f9a2fe00640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9a10077f70 0x7f9a1007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.791+0000 7f9a2fe00640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9a10077f70 0x7f9a1007a430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c007fd0 tx=0x7f9a1c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:25.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:25.794+0000 7f9a2cc00640 1 -- 172.21.15.100:0/3535794560 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9a2403f030 con 0x7f9a3006eb60 2024-09-10T21:06:26.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.022+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9a300b2340 con 0x7f9a3006eb60 2024-09-10T21:06:26.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.025+0000 7f9a2cc00640 1 -- 172.21.15.100:0/3535794560 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193249 (secure 0 0 0) 0x7f9a240839a0 con 0x7f9a3006eb60 2024-09-10T21:06:26.032 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:26.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9a10077f70 msgr2=0x7f9a1007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9a10077f70 0x7f9a1007a430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c007fd0 tx=0x7f9a1c009040 comp rx=0 tx=0).stop 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3006eb60 msgr2=0x7f9a30145440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3006eb60 0x7f9a30145440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009780 tx=0x7f9a24033d60 comp rx=0 tx=0).stop 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 shutdown_connections 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9a10077f70 0x7f9a1007a430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a3015b4d0 0x7f9a301ea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a300cf810 0x7f9a30146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 --2- 172.21.15.100:0/3535794560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a3006eb60 0x7f9a30145440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 >> 172.21.15.100:0/3535794560 conn(0x7f9a3006cb50 msgr2=0x7f9a300b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 shutdown_connections 2024-09-10T21:06:26.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.028+0000 7f9a37600640 1 -- 172.21.15.100:0/3535794560 wait complete. 2024-09-10T21:06:26.048 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"flags":0,"active_gid":4115,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1902480365},{"type":"v1","addr":"172.21.15.130:6801","nonce":1902480365}]},"active_addr":"172.21.15.130:6801/1902480365","active_change":"2024-09-10T21:05:46.675005+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4122,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":3124570919}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":2765207249}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":171767052}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":2356703022}]}]} 2024-09-10T21:06:26.052 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T21:06:26.052 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T21:06:26.052 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:26.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.205+0000 7f7f86a00640 1 -- 172.21.15.100:0/2697247008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f800741e0 msgr2=0x7f7f8015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.205+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2697247008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f800741e0 0x7f7f8015f4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009830 tx=0x7f7f6c02a480 comp rx=0 tx=0).stop 2024-09-10T21:06:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.206+0000 7f7f86a00640 1 -- 172.21.15.100:0/2697247008 shutdown_connections 2024-09-10T21:06:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.206+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2697247008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f800741e0 0x7f7f8015f4d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.206+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2697247008 >> v2:172.21.15.130:3300/0 conn(0x7f7f8015b680 0x7f7f8015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.206+0000 7f7f86a00640 1 -- 172.21.15.100:0/2697247008 >> 172.21.15.100:0/2697247008 conn(0x7f7f8006cb50 msgr2=0x7f7f8006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.206+0000 7f7f86a00640 1 -- 172.21.15.100:0/2697247008 shutdown_connections 2024-09-10T21:06:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.206+0000 7f7f86a00640 1 -- 172.21.15.100:0/2697247008 wait complete. 2024-09-10T21:06:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.207+0000 7f7f86a00640 1 Processor -- start 2024-09-10T21:06:26.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.207+0000 7f7f86a00640 1 -- start start 2024-09-10T21:06:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f86a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800741e0 0x7f7f801f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f86a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f8015b680 0x7f7f80152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f86a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f8015c750 0x7f7f8014f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f86a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f800b29e0 con 0x7f7f800741e0 2024-09-10T21:06:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f86a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f800b2860 con 0x7f7f8015c750 2024-09-10T21:06:26.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f86a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7f800b2b60 con 0x7f7f8015b680 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800741e0 0x7f7f801f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800741e0 0x7f7f801f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34878/0 (socket says 172.21.15.100:34878) 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.208+0000 7f7f7fe00640 1 -- 172.21.15.100:0/2165133221 learned_addr learned my addr 172.21.15.100:0/2165133221 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f7f400640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f8015b680 0x7f7f80152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f84a00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f8015c750 0x7f7f8014f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f7fe00640 1 -- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f8015b680 msgr2=0x7f7f80152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f7fe00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f8015b680 0x7f7f80152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f7fe00640 1 -- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f8015c750 msgr2=0x7f7f8014f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f7fe00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f8015c750 0x7f7f8014f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f7fe00640 1 -- 172.21.15.100:0/2165133221 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f801f6140 con 0x7f7f800741e0 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f84a00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f8015c750 0x7f7f8014f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:26.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f7fe00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800741e0 0x7f7f801f5a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000ebc0 tx=0x7f7f7000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f77e00640 1 -- 172.21.15.100:0/2165133221 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70010630 con 0x7f7f800741e0 2024-09-10T21:06:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f77e00640 1 -- 172.21.15.100:0/2165133221 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f700108c0 con 0x7f7f800741e0 2024-09-10T21:06:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f801f6420 con 0x7f7f800741e0 2024-09-10T21:06:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.209+0000 7f7f77e00640 1 -- 172.21.15.100:0/2165133221 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70010d10 con 0x7f7f800741e0 2024-09-10T21:06:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.210+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f801f2b80 con 0x7f7f800741e0 2024-09-10T21:06:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.211+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f801f6940 con 0x7f7f800741e0 2024-09-10T21:06:26.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.212+0000 7f7f77e00640 1 -- 172.21.15.100:0/2165133221 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7f70018420 con 0x7f7f800741e0 2024-09-10T21:06:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.213+0000 7f7f77e00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f60077f70 0x7f7f6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.213+0000 7f7f77e00640 1 -- 172.21.15.100:0/2165133221 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7f7009aec0 con 0x7f7f800741e0 2024-09-10T21:06:26.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.213+0000 7f7f7f400640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f60077f70 0x7f7f6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.214+0000 7f7f7f400640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f60077f70 0x7f7f6007a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c034000 tx=0x7f7f6c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.217+0000 7f7f77e00640 1 -- 172.21.15.100:0/2165133221 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7f801f6940 con 0x7f7f800741e0 2024-09-10T21:06:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.406+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f800cc260 con 0x7f7f800741e0 2024-09-10T21:06:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.407+0000 7f7f77e00640 1 -- 172.21.15.100:0/2165133221 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7f7f800cc260 con 0x7f7f800741e0 2024-09-10T21:06:26.412 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:26.412 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f60077f70 msgr2=0x7f7f6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f60077f70 0x7f7f6007a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c034000 tx=0x7f7f6c004730 comp rx=0 tx=0).stop 2024-09-10T21:06:26.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800741e0 msgr2=0x7f7f801f5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800741e0 0x7f7f801f5a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000ebc0 tx=0x7f7f7000c6a0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 shutdown_connections 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f60077f70 0x7f7f6007a430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f8015c750 0x7f7f8014f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f8015b680 0x7f7f80152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 --2- 172.21.15.100:0/2165133221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800741e0 0x7f7f801f5a40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.409+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 >> 172.21.15.100:0/2165133221 conn(0x7f7f8006cb50 msgr2=0x7f7f8015ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.410+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 shutdown_connections 2024-09-10T21:06:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.410+0000 7f7f86a00640 1 -- 172.21.15.100:0/2165133221 wait complete. 2024-09-10T21:06:26.431 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T21:06:26.431 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.584+0000 7fe58b000640 1 -- 172.21.15.100:0/3726420729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 msgr2=0x7fe5840b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.584+0000 7fe58b000640 1 --2- 172.21.15.100:0/3726420729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 0x7fe5840b21c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe578009830 tx=0x7fe57802a480 comp rx=0 tx=0).stop 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.584+0000 7fe58b000640 1 -- 172.21.15.100:0/3726420729 shutdown_connections 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.584+0000 7fe58b000640 1 --2- 172.21.15.100:0/3726420729 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe58406e0a0 0x7fe5840d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.584+0000 7fe58b000640 1 --2- 172.21.15.100:0/3726420729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 0x7fe5840b21c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.584+0000 7fe58b000640 1 -- 172.21.15.100:0/3726420729 >> 172.21.15.100:0/3726420729 conn(0x7fe5840d3ab0 msgr2=0x7fe5840d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.584+0000 7fe58b000640 1 -- 172.21.15.100:0/3726420729 shutdown_connections 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.584+0000 7fe58b000640 1 -- 172.21.15.100:0/3726420729 wait complete. 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.585+0000 7fe58b000640 1 Processor -- start 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.586+0000 7fe58b000640 1 -- start start 2024-09-10T21:06:26.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.586+0000 7fe58b000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe58406e0a0 0x7fe584151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.586+0000 7fe58b000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 0x7fe58415de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.586+0000 7fe58b000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe58415e350 0x7fe5840b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.586+0000 7fe58b000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe58406e770 con 0x7fe584161140 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.586+0000 7fe58b000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe584161730 con 0x7fe58415e350 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.586+0000 7fe58b000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe58406e8f0 con 0x7fe58406e0a0 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 0x7fe58415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 0x7fe58415de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34888/0 (socket says 172.21.15.100:34888) 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 -- 172.21.15.100:0/2702902506 learned_addr learned my addr 172.21.15.100:0/2702902506 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589c00640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe58406e0a0 0x7fe584151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe58a600640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe58415e350 0x7fe5840b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 -- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe58406e0a0 msgr2=0x7fe584151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe58406e0a0 0x7fe584151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 -- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe58415e350 msgr2=0x7fe5840b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe58415e350 0x7fe5840b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 -- 172.21.15.100:0/2702902506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5840cac20 con 0x7fe584161140 2024-09-10T21:06:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.587+0000 7fe589200640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 0x7fe58415de10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe57000d770 tx=0x7fe57000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.588+0000 7fe581600640 1 -- 172.21.15.100:0/2702902506 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570017070 con 0x7fe584161140 2024-09-10T21:06:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.588+0000 7fe581600640 1 -- 172.21.15.100:0/2702902506 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe570009d20 con 0x7fe584161140 2024-09-10T21:06:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.588+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5840caf00 con 0x7fe584161140 2024-09-10T21:06:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.588+0000 7fe581600640 1 -- 172.21.15.100:0/2702902506 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570004280 con 0x7fe584161140 2024-09-10T21:06:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.588+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5840cb4c0 con 0x7fe584161140 2024-09-10T21:06:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.589+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe584152460 con 0x7fe584161140 2024-09-10T21:06:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.590+0000 7fe581600640 1 -- 172.21.15.100:0/2702902506 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe5700035f0 con 0x7fe584161140 2024-09-10T21:06:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.591+0000 7fe581600640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe564077fa0 0x7fe56407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.591+0000 7fe581600640 1 -- 172.21.15.100:0/2702902506 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe57009a1d0 con 0x7fe584161140 2024-09-10T21:06:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.591+0000 7fe589c00640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe564077fa0 0x7fe56407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.592+0000 7fe589c00640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe564077fa0 0x7fe56407a460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe578034000 tx=0x7fe578004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.595+0000 7fe581600640 1 -- 172.21.15.100:0/2702902506 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe5700622a0 con 0x7fe584161140 2024-09-10T21:06:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.782+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe58415f6d0 con 0x7fe584161140 2024-09-10T21:06:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.783+0000 7fe581600640 1 -- 172.21.15.100:0/2702902506 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fe570066cd0 con 0x7fe584161140 2024-09-10T21:06:26.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:26.789 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe564077fa0 msgr2=0x7fe56407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe564077fa0 0x7fe56407a460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe578034000 tx=0x7fe578004730 comp rx=0 tx=0).stop 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 msgr2=0x7fe58415de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 0x7fe58415de10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe57000d770 tx=0x7fe57000dc30 comp rx=0 tx=0).stop 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 shutdown_connections 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe564077fa0 0x7fe56407a460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe58415e350 0x7fe5840b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe584161140 0x7fe58415de10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 --2- 172.21.15.100:0/2702902506 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe58406e0a0 0x7fe584151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 >> 172.21.15.100:0/2702902506 conn(0x7fe5840d3ab0 msgr2=0x7fe5840d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 shutdown_connections 2024-09-10T21:06:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:26.786+0000 7fe58b000640 1 -- 172.21.15.100:0/2702902506 wait complete. 2024-09-10T21:06:26.807 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T21:06:26.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T21:06:26.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T21:06:26.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T21:06:26.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T21:06:26.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T21:06:26.810 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T21:06:26.810 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T21:06:27.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.081+0000 7fcf73a00640 1 -- 172.21.15.100:0/2753311932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c0cf1a0 msgr2=0x7fcf6c06f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.081+0000 7fcf73a00640 1 --2- 172.21.15.100:0/2753311932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c0cf1a0 0x7fcf6c06f3e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c072400 tx=0x7fcf6002a560 comp rx=0 tx=0).stop 2024-09-10T21:06:27.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.082+0000 7fcf73a00640 1 -- 172.21.15.100:0/2753311932 shutdown_connections 2024-09-10T21:06:27.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.082+0000 7fcf73a00640 1 --2- 172.21.15.100:0/2753311932 >> v2:172.21.15.130:3300/0 conn(0x7fcf6c15b980 0x7fcf6c06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.082+0000 7fcf73a00640 1 --2- 172.21.15.100:0/2753311932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c0cf1a0 0x7fcf6c06f3e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.082+0000 7fcf73a00640 1 -- 172.21.15.100:0/2753311932 >> 172.21.15.100:0/2753311932 conn(0x7fcf6c06cb50 msgr2=0x7fcf6c06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.083+0000 7fcf73a00640 1 -- 172.21.15.100:0/2753311932 shutdown_connections 2024-09-10T21:06:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.083+0000 7fcf73a00640 1 -- 172.21.15.100:0/2753311932 wait complete. 2024-09-10T21:06:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.083+0000 7f473ae00640 1 -- 172.21.15.100:0/832523942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472c0e2750 msgr2=0x7f472c0576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.083+0000 7f473ae00640 1 --2- 172.21.15.100:0/832523942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472c0e2750 0x7f472c0576d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4728009830 tx=0x7f472802a440 comp rx=0 tx=0).stop 2024-09-10T21:06:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.083+0000 7f473ae00640 1 -- 172.21.15.100:0/832523942 shutdown_connections 2024-09-10T21:06:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.083+0000 7f473ae00640 1 --2- 172.21.15.100:0/832523942 >> v2:172.21.15.130:3300/0 conn(0x7f472c03d100 0x7f472c005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.083+0000 7f473ae00640 1 --2- 172.21.15.100:0/832523942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472c0e2750 0x7f472c0576d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.083+0000 7f473ae00640 1 -- 172.21.15.100:0/832523942 >> 172.21.15.100:0/832523942 conn(0x7f472c00e1e0 msgr2=0x7f472c00e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.084+0000 7f08c8e00640 1 -- 172.21.15.100:0/1169665040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08bc037bf0 msgr2=0x7f08bc053120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.084+0000 7f08c8e00640 1 --2- 172.21.15.100:0/1169665040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08bc037bf0 0x7f08bc053120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f08c406b200 tx=0x7f08c40a59e0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.084+0000 7f08c8e00640 1 -- 172.21.15.100:0/1169665040 shutdown_connections 2024-09-10T21:06:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.084+0000 7f08c8e00640 1 --2- 172.21.15.100:0/1169665040 >> v2:172.21.15.130:3300/0 conn(0x7f08bc008e90 0x7f08bc053660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.084+0000 7f08c8e00640 1 --2- 172.21.15.100:0/1169665040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08bc037bf0 0x7f08bc053120 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.085+0000 7f08c8e00640 1 -- 172.21.15.100:0/1169665040 >> 172.21.15.100:0/1169665040 conn(0x7f08bc056770 msgr2=0x7f08bc056b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.085+0000 7f08c8e00640 1 -- 172.21.15.100:0/1169665040 shutdown_connections 2024-09-10T21:06:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.085+0000 7f08c8e00640 1 -- 172.21.15.100:0/1169665040 wait complete. 2024-09-10T21:06:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.086+0000 7f473ae00640 1 -- 172.21.15.100:0/832523942 shutdown_connections 2024-09-10T21:06:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.085+0000 7fcf73a00640 1 Processor -- start 2024-09-10T21:06:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.087+0000 7f08c8e00640 1 Processor -- start 2024-09-10T21:06:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.087+0000 7fcf73a00640 1 -- start start 2024-09-10T21:06:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.087+0000 7f08c8e00640 1 -- start start 2024-09-10T21:06:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.087+0000 7f473ae00640 1 -- 172.21.15.100:0/832523942 wait complete. 2024-09-10T21:06:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.088+0000 7fcf73a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf6c0cf1a0 0x7fcf6c0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.088+0000 7fcf73a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c15b980 0x7fcf6c1f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.088+0000 7fcf73a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf6c15e2a0 0x7fcf6c0ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.088+0000 7fcf73a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c0b3760 con 0x7fcf6c15b980 2024-09-10T21:06:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.088+0000 7fcf73a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c0b35e0 con 0x7fcf6c15e2a0 2024-09-10T21:06:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.088+0000 7fcf73a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6c0b38e0 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7f08c8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08bc008e90 0x7f08bc179db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7f08c8e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08bc037bf0 0x7f08bc178d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7f08c8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc0395c0 0x7f08bc00cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7f08c8e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc0521b0 con 0x7f08bc0395c0 2024-09-10T21:06:27.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7f08c8e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc052030 con 0x7f08bc008e90 2024-09-10T21:06:27.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7f08c8e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f08bc052330 con 0x7f08bc037bf0 2024-09-10T21:06:27.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7fcf71a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf6c15e2a0 0x7fcf6c0ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7fb5b1a00640 1 -- 172.21.15.100:0/89275816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 msgr2=0x7fb5a4035fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7fb5b1a00640 1 --2- 172.21.15.100:0/89275816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 0x7fb5a4035fe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb59c005fd0 tx=0x7fb59c02b180 comp rx=0 tx=0).stop 2024-09-10T21:06:27.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f473ae00640 1 Processor -- start 2024-09-10T21:06:27.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08bc008e90 0x7f08bc179db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c2a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08bc037bf0 0x7f08bc178d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7fcf71a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf6c15e2a0 0x7fcf6c0ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:52612/0 (socket says 172.21.15.100:52612) 2024-09-10T21:06:27.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.089+0000 7fcf71a00640 1 -- 172.21.15.100:0/1460434576 learned_addr learned my addr 172.21.15.100:0/1460434576 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7fcf71000640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf6c0cf1a0 0x7fcf6c0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08bc008e90 0x7f08bc179db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:52620/0 (socket says 172.21.15.100:52620) 2024-09-10T21:06:27.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c2a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08bc037bf0 0x7f08bc178d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58402/0 (socket says 172.21.15.100:58402) 2024-09-10T21:06:27.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c2a00640 1 -- 172.21.15.100:0/3980174557 learned_addr learned my addr 172.21.15.100:0/3980174557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7fcf6be00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c15b980 0x7fcf6c1f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7fcf71000640 1 -- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf6c15e2a0 msgr2=0x7fcf6c0ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c3400640 1 -- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08bc037bf0 msgr2=0x7f08bc178d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c3400640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08bc037bf0 0x7f08bc178d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7fb5b1a00640 1 -- 172.21.15.100:0/89275816 shutdown_connections 2024-09-10T21:06:27.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7fb5b1a00640 1 --2- 172.21.15.100:0/89275816 >> v2:172.21.15.130:3300/0 conn(0x7fb5a4036520 0x7fb5a4009a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7fb5b1a00640 1 --2- 172.21.15.100:0/89275816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 0x7fb5a4035fe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7fb5b1a00640 1 -- 172.21.15.100:0/89275816 >> 172.21.15.100:0/89275816 conn(0x7fb5a4054560 msgr2=0x7fb5a4054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7fcf71000640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf6c15e2a0 0x7fcf6c0ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7fcf71000640 1 -- 172.21.15.100:0/1460434576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c15b980 msgr2=0x7fcf6c1f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7fcf71000640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c15b980 0x7fcf6c1f9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7fcf71000640 1 -- 172.21.15.100:0/1460434576 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6c1f9840 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7fcf71a00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf6c15e2a0 0x7fcf6c0ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:27.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c3400640 1 -- 172.21.15.100:0/3980174557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc0395c0 msgr2=0x7f08bc00cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c3400640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc0395c0 0x7f08bc00cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f08c3400640 1 -- 172.21.15.100:0/3980174557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc17cda0 con 0x7f08bc008e90 2024-09-10T21:06:27.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7fcf71000640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf6c0cf1a0 0x7fcf6c0af2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcf60031000 tx=0x7fcf60003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.090+0000 7f473ae00640 1 -- start start 2024-09-10T21:06:27.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7f473ae00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f472c03d100 0x7f472c0d5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7f473ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472c0e2750 0x7f472c0d2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7f473ae00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472c0e2b30 0x7f472c0d3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7f473ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f472c006c60 con 0x7f472c0e2750 2024-09-10T21:06:27.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7f473ae00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f472c006ae0 con 0x7f472c03d100 2024-09-10T21:06:27.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7f473ae00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f472c006de0 con 0x7f472c0e2b30 2024-09-10T21:06:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7f08c3400640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08bc008e90 0x7f08bc179db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08c406c060 tx=0x7f08c40b47f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7f4739a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f472c03d100 0x7f472c0d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7fb5b1a00640 1 -- 172.21.15.100:0/89275816 shutdown_connections 2024-09-10T21:06:27.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.091+0000 7fb5b1a00640 1 -- 172.21.15.100:0/89275816 wait complete. 2024-09-10T21:06:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7f4739000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472c0e2750 0x7f472c0d2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6003f070 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf60004890 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60035030 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7f4739000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472c0e2750 0x7f472c0d2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34930/0 (socket says 172.21.15.100:34930) 2024-09-10T21:06:27.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6c0a9d60 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6c1500e0 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7f4739000640 1 -- 172.21.15.100:0/1973061833 learned_addr learned my addr 172.21.15.100:0/1973061833 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.092+0000 7f473a400640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472c0e2b30 0x7f472c0d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.093+0000 7f473a400640 1 -- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f472c03d100 msgr2=0x7f472c0d5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.093+0000 7f473a400640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f472c03d100 0x7f472c0d5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.093+0000 7f473a400640 1 -- 172.21.15.100:0/1973061833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472c0e2750 msgr2=0x7f472c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.093+0000 7f473a400640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f472c0e2750 0x7f472c0d2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.093+0000 7f473a400640 1 -- 172.21.15.100:0/1973061833 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c036c00 con 0x7f472c0e2b30 2024-09-10T21:06:27.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.093+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c40c3070 con 0x7f08bc008e90 2024-09-10T21:06:27.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.093+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08c40b4d90 con 0x7f08bc008e90 2024-09-10T21:06:27.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.093+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c40c3070 con 0x7f08bc008e90 2024-09-10T21:06:27.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.094+0000 7fb5b1a00640 1 Processor -- start 2024-09-10T21:06:27.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.094+0000 7f473a400640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472c0e2b30 0x7f472c0d3050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4734066520 tx=0x7f473406df30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.094+0000 7f4739a00640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f472c03d100 0x7f472c0d5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:27.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.094+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08bc17d080 con 0x7f08bc008e90 2024-09-10T21:06:27.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.094+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08bc17d640 con 0x7f08bc008e90 2024-09-10T21:06:27.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.095+0000 7fb5b1a00640 1 -- start start 2024-09-10T21:06:27.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.095+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734099070 con 0x7f472c0e2b30 2024-09-10T21:06:27.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.095+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47340757f0 con 0x7f472c0e2b30 2024-09-10T21:06:27.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.095+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734099070 con 0x7f472c0e2b30 2024-09-10T21:06:27.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.095+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472c036ee0 con 0x7f472c0e2b30 2024-09-10T21:06:27.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.096+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f472c02f430 con 0x7f472c0e2b30 2024-09-10T21:06:27.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.097+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f472c02f240 con 0x7f472c0e2b30 2024-09-10T21:06:27.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.097+0000 7fb5b1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 0x7fb5a417d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcf60004ca0 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf48001030 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.096+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08a0001030 con 0x7f08bc008e90 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7fb5aaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 0x7fb5a417d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7fb5aaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 0x7fb5a417d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34940/0 (socket says 172.21.15.100:34940) 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7fb5b1a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a401c890 0x7fb5a404d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7fb5b1a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a4036520 0x7fb5a404dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7fb5aaa00640 1 -- 172.21.15.100:0/2436169862 learned_addr learned my addr 172.21.15.100:0/2436169862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a4009f90 con 0x7fb5a4005a60 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a400bc10 con 0x7fb5a401c890 2024-09-10T21:06:27.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7fb5aa000640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a401c890 0x7fb5a404d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7fb5ab400640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a4036520 0x7fb5a404dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7ff9c6800640 1 -- 172.21.15.100:0/540242676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d24d0 msgr2=0x7ff9c00d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7ff9c6800640 1 --2- 172.21.15.100:0/540242676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d24d0 0x7ff9c00d01f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00b6630 tx=0x7ff9ac02a4b0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7ff9c6800640 1 -- 172.21.15.100:0/540242676 shutdown_connections 2024-09-10T21:06:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7ff9c6800640 1 --2- 172.21.15.100:0/540242676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d24d0 0x7ff9c00d01f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7ff9c6800640 1 --2- 172.21.15.100:0/540242676 >> v2:172.21.15.130:3300/0 conn(0x7ff9c015db30 0x7ff9c00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.098+0000 7ff9c6800640 1 -- 172.21.15.100:0/540242676 >> 172.21.15.100:0/540242676 conn(0x7ff9c00d3a40 msgr2=0x7ff9c00d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a400a110 con 0x7fb5a4036520 2024-09-10T21:06:27.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7ff9c6800640 1 -- 172.21.15.100:0/540242676 shutdown_connections 2024-09-10T21:06:27.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7ff9c6800640 1 -- 172.21.15.100:0/540242676 wait complete. 2024-09-10T21:06:27.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7fcf68c00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcf4c078040 0x7fcf4c07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcf600bb590 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fcf68c00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7fcf4c0817c0 0x7fcf4c083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 --> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf4c0842d0 con 0x7fcf4c0817c0 2024-09-10T21:06:27.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fb5ab400640 1 -- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a401c890 msgr2=0x7fb5a404d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf600c2050 con 0x7fcf6c0cf1a0 2024-09-10T21:06:27.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fcf6be00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcf4c078040 0x7fcf4c07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fb5ab400640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a401c890 0x7fb5a404d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7fcf71a00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7fcf4c0817c0 0x7fcf4c083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fb5ab400640 1 -- 172.21.15.100:0/2436169862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 msgr2=0x7fb5a417d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fb5ab400640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 0x7fb5a417d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7fb5ab400640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a4048130 con 0x7fb5a4036520 2024-09-10T21:06:27.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7fb5aaa00640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a4005a60 0x7fb5a417d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:27.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.099+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4734093030 con 0x7f472c0e2b30 2024-09-10T21:06:27.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.100+0000 7f4731600640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4714078170 0x7f471407a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4734114640 con 0x7f472c0e2b30 2024-09-10T21:06:27.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7f4731600640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7f47140817f0 0x7f4714083c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 --> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4714084300 con 0x7f47140817f0 2024-09-10T21:06:27.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7fb5ab400640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a4036520 0x7fb5a404dcb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac06b760 tx=0x7fb5ac06df30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f473411b050 con 0x7f472c0e2b30 2024-09-10T21:06:27.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.102+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f08c40c6360 con 0x7f08bc008e90 2024-09-10T21:06:27.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.102+0000 7ff9c6800640 1 Processor -- start 2024-09-10T21:06:27.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7fcf6be00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcf4c078040 0x7fcf4c07a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c1f64a0 tx=0x7fcf58005cc0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.101+0000 7fcf71a00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7fcf4c0817c0 0x7fcf4c083c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.103+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 <== osd.0 v2:172.21.15.100:6800/2888312606 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf4c0842d0 con 0x7fcf4c0817c0 2024-09-10T21:06:27.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.102+0000 7f4739000640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7f47140817f0 0x7f4714083c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.103+0000 7f4739000640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7f47140817f0 0x7f4714083c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7f4739a00640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4714078170 0x7f471407a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.103+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac098070 con 0x7fb5a4036520 2024-09-10T21:06:27.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.103+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5ac06a440 con 0x7fb5a4036520 2024-09-10T21:06:27.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.103+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac075690 con 0x7fb5a4036520 2024-09-10T21:06:27.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a4048410 con 0x7fb5a4036520 2024-09-10T21:06:27.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.102+0000 7ff9c6800640 1 -- start start 2024-09-10T21:06:27.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d4560 0x7ff9c0160d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c6800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9c015db30 0x7ff9c015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c6800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9c01f89c0 0x7ff9c015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d4560 0x7ff9c0160d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d4560 0x7ff9c0160d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34962/0 (socket says 172.21.15.100:34962) 2024-09-10T21:06:27.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a40489d0 con 0x7fb5a4036520 2024-09-10T21:06:27.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c5400640 1 -- 172.21.15.100:0/3760837227 learned_addr learned my addr 172.21.15.100:0/3760837227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00d08b0 con 0x7ff9c00d4560 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00d0730 con 0x7ff9c015db30 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c00d0a30 con 0x7ff9c01f89c0 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.105+0000 7ff9c5e00640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9c01f89c0 0x7ff9c015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7f08b7400640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f08a4078170 0x7f08a407a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f08c4135770 con 0x7f08bc008e90 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7f08b7400640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7f08a4081870 0x7f08a4083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 --> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08c40a7ec0 con 0x7f08a4081870 2024-09-10T21:06:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.104+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f08c413c050 con 0x7f08bc008e90 2024-09-10T21:06:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.105+0000 7ff9c5400640 1 -- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9c01f89c0 msgr2=0x7ff9c015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.105+0000 7ff9c5400640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9c01f89c0 0x7ff9c015e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.105+0000 7ff9c5400640 1 -- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9c015db30 msgr2=0x7ff9c015a590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:06:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.105+0000 7ff9c5400640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9c015db30 0x7ff9c015a590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.105+0000 7ff9c5400640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c01f8e80 con 0x7ff9c00d4560 2024-09-10T21:06:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.106+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 <== osd.2 v2:172.21.15.100:6808/838833345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4714084300 con 0x7f47140817f0 2024-09-10T21:06:27.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.106+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5a400c1c0 con 0x7fb5a4036520 2024-09-10T21:06:27.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.106+0000 7ff9c5400640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d4560 0x7ff9c0160d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400e7c0 tx=0x7ff9b400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400ccc0 con 0x7ff9c00d4560 2024-09-10T21:06:27.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f3288000640 1 -- 172.21.15.100:0/2323899202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 msgr2=0x7f32800cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f3288000640 1 --2- 172.21.15.100:0/2323899202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 0x7f32800cf0c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f326c009830 tx=0x7f326c02a510 comp rx=0 tx=0).stop 2024-09-10T21:06:27.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f3288000640 1 -- 172.21.15.100:0/2323899202 shutdown_connections 2024-09-10T21:06:27.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f3288000640 1 --2- 172.21.15.100:0/2323899202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 0x7f32800cf0c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f3288000640 1 --2- 172.21.15.100:0/2323899202 >> v2:172.21.15.100:3300/0 conn(0x7f328015ded0 0x7f32800ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f3288000640 1 -- 172.21.15.100:0/2323899202 >> 172.21.15.100:0/2323899202 conn(0x7f32800d3c50 msgr2=0x7f32800d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f3288000640 1 -- 172.21.15.100:0/2323899202 shutdown_connections 2024-09-10T21:06:27.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9b400ce60 con 0x7ff9c00d4560 2024-09-10T21:06:27.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4005280 con 0x7ff9c00d4560 2024-09-10T21:06:27.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c01604e0 con 0x7ff9c00d4560 2024-09-10T21:06:27.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c01f4ad0 con 0x7ff9c00d4560 2024-09-10T21:06:27.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f3288000640 1 -- 172.21.15.100:0/2323899202 wait complete. 2024-09-10T21:06:27.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.108+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9c015aad0 con 0x7ff9c00d4560 2024-09-10T21:06:27.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.107+0000 7f08c2a00640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f08a4078170 0x7f08a407a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.109+0000 7f3288000640 1 Processor -- start 2024-09-10T21:06:27.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.109+0000 7f08c3e00640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7f08a4081870 0x7f08a4083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.109+0000 7f3288000640 1 -- start start 2024-09-10T21:06:27.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.110+0000 7f6256200640 1 -- 172.21.15.100:0/292994574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62480366f0 msgr2=0x7f62480eb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.110+0000 7f6256200640 1 --2- 172.21.15.100:0/292994574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62480366f0 0x7f62480eb390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6250052150 tx=0x7f62500a59e0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.110+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb5ac092030 con 0x7fb5a4036520 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.110+0000 7f3288000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 0x7f328015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.110+0000 7f3288000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32800d0390 0x7f32800c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3288000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328015ded0 0x7f32800b8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3288000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32800b8460 con 0x7f32800d0390 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3288000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32800b82e0 con 0x7f328015ded0 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3288000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f32800b85e0 con 0x7f32800ceca0 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f6256200640 1 -- 172.21.15.100:0/292994574 shutdown_connections 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f6256200640 1 --2- 172.21.15.100:0/292994574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62480366f0 0x7f62480eb390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f6256200640 1 -- 172.21.15.100:0/292994574 >> 172.21.15.100:0/292994574 conn(0x7f6248054560 msgr2=0x7f6248054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f4739a00640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4714078170 0x7f471407a630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4728034000 tx=0x7f4728004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3285600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 0x7f328015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff9b4005420 con 0x7ff9c00d4560 2024-09-10T21:06:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3284c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32800d0390 0x7f32800c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3285600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 0x7f328015aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58448/0 (socket says 172.21.15.100:58448) 2024-09-10T21:06:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3285600640 1 -- 172.21.15.100:0/3789836110 learned_addr learned my addr 172.21.15.100:0/3789836110 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.110+0000 7f08c2a00640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f08a4078170 0x7f08a407a630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08bc17c8b0 tx=0x7f08b8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f08c3e00640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7f08a4081870 0x7f08a4083cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f6256200640 1 -- 172.21.15.100:0/292994574 shutdown_connections 2024-09-10T21:06:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f3286000640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328015ded0 0x7f32800b8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7efecae00640 1 -- 172.21.15.100:0/239715786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec4153ca0 msgr2=0x7efec41540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7efecae00640 1 --2- 172.21.15.100:0/239715786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec4153ca0 0x7efec41540f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efeb0005fd0 tx=0x7efeb002a5d0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7f3285600640 1 -- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328015ded0 msgr2=0x7f32800b8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7f3285600640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328015ded0 0x7f32800b8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7f3285600640 1 -- 172.21.15.100:0/3789836110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32800d0390 msgr2=0x7f32800c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7f3285600640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32800d0390 0x7f32800c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7f3285600640 1 -- 172.21.15.100:0/3789836110 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3280160130 con 0x7f32800ceca0 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7efecae00640 1 -- 172.21.15.100:0/239715786 shutdown_connections 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7efecae00640 1 --2- 172.21.15.100:0/239715786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec4153ca0 0x7efec41540f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7efecae00640 1 --2- 172.21.15.100:0/239715786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efec40b4950 0x7efec415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7efecae00640 1 -- 172.21.15.100:0/239715786 >> 172.21.15.100:0/239715786 conn(0x7efec406cb50 msgr2=0x7efec406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7f3285600640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 0x7f328015aae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f327800ea50 tx=0x7f327800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.112+0000 7ff9bd600640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9a0077fa0 0x7ff9a007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7efecae00640 1 -- 172.21.15.100:0/239715786 shutdown_connections 2024-09-10T21:06:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7efecae00640 1 -- 172.21.15.100:0/239715786 wait complete. 2024-09-10T21:06:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff9b409ac30 con 0x7ff9c00d4560 2024-09-10T21:06:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327800cdc0 con 0x7f32800ceca0 2024-09-10T21:06:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 <== osd.1 v2:172.21.15.100:6811/3537518613 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08c40a7ec0 con 0x7f08a4081870 2024-09-10T21:06:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3278011560 con 0x7f32800ceca0 2024-09-10T21:06:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278011990 con 0x7f32800ceca0 2024-09-10T21:06:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7ff9c4a00640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9a0077fa0 0x7ff9a007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7ff9bd600640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7ff9a0081720 0x7ff9a0083b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3280160410 con 0x7f32800ceca0 2024-09-10T21:06:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f328015b020 con 0x7f32800ceca0 2024-09-10T21:06:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9b4013e50 con 0x7ff9a0081720 2024-09-10T21:06:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.113+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff9b409b020 con 0x7ff9c00d4560 2024-09-10T21:06:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.114+0000 7ff9c5e00640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7ff9a0081720 0x7ff9a0083b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.114+0000 7ff9c4a00640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9a0077fa0 0x7ff9a007a460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac034000 tx=0x7ff9ac004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.115+0000 7ff9c5e00640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7ff9a0081720 0x7ff9a0083b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.115+0000 7efecae00640 1 Processor -- start 2024-09-10T21:06:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 <== osd.4 v2:172.21.15.130:6818/2230230044 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b4013e50 con 0x7ff9a0081720 2024-09-10T21:06:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7efecae00640 1 -- start start 2024-09-10T21:06:27.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.111+0000 7f6256200640 1 -- 172.21.15.100:0/292994574 wait complete. 2024-09-10T21:06:27.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.114+0000 7f6256200640 1 Processor -- start 2024-09-10T21:06:27.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.115+0000 7fb5a2a00640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb58c078070 0x7fb58c07a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.115+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb5ac115230 con 0x7fb5a4036520 2024-09-10T21:06:27.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7fb5a2a00640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7fb58c0817f0 0x7fb58c083c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5ac0643f0 con 0x7fb58c0817f0 2024-09-10T21:06:27.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb5ac115620 con 0x7fb5a4036520 2024-09-10T21:06:27.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7fb5aa000640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7fb58c0817f0 0x7fb58c083c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7f6256200640 1 -- start start 2024-09-10T21:06:27.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3278022030 con 0x7f32800ceca0 2024-09-10T21:06:27.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.116+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f325c001030 con 0x7f32800ceca0 2024-09-10T21:06:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7f327d600640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3260078040 0x7f326007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f327809a830 con 0x7f32800ceca0 2024-09-10T21:06:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7f3284c00640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3260078040 0x7f326007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7efecae00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec4070540 0x7efec41457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7fb5aaa00640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb58c078070 0x7fb58c07a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7fb5aa000640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7fb58c0817f0 0x7fb58c083c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7f327d600640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7f32600817c0 0x7f3260083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 --> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f327801fe50 con 0x7f32600817c0 2024-09-10T21:06:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.117+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32780a1050 con 0x7f32800ceca0 2024-09-10T21:06:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7efecae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40b4950 0x7efec41f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7efecae00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efec4153ca0 0x7efec41f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7f3286000640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7f32600817c0 0x7f3260083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7f3284c00640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3260078040 0x7f326007a500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f326c034000 tx=0x7f326c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7efecae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efec40741e0 con 0x7efec40b4950 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7efecae00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efec4074060 con 0x7efec4070540 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7efecae00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7efec4074360 con 0x7efec4153ca0 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7efec8e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efec4153ca0 0x7efec41f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7efec8e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efec4153ca0 0x7efec41f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58456/0 (socket says 172.21.15.100:58456) 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.118+0000 7efec8e00640 1 -- 172.21.15.100:0/439278508 learned_addr learned my addr 172.21.15.100:0/439278508 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.119+0000 7efec3e00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec4070540 0x7efec41457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.119+0000 7efec8e00640 1 -- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec4070540 msgr2=0x7efec41457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.119+0000 7efec8e00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efec4070540 0x7efec41457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.119+0000 7efec8e00640 1 -- 172.21.15.100:0/439278508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40b4950 msgr2=0x7efec41f7cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.119+0000 7efec8e00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40b4950 0x7efec41f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.119+0000 7efec8e00640 1 -- 172.21.15.100:0/439278508 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec41572c0 con 0x7efec4153ca0 2024-09-10T21:06:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.119+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 <== osd.3 v2:172.21.15.100:6824/392814175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5ac0643f0 con 0x7fb58c0817f0 2024-09-10T21:06:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.119+0000 7fb5aaa00640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb58c078070 0x7fb58c07a530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb598001c10 tx=0x7fb598009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.120+0000 7efec8e00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efec4153ca0 0x7efec41f8200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efeb0006010 tx=0x7efeb0003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.120+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb003e030 con 0x7efec4153ca0 2024-09-10T21:06:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.120+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efeb0003b20 con 0x7efec4153ca0 2024-09-10T21:06:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.120+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0035040 con 0x7efec4153ca0 2024-09-10T21:06:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.120+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec4156fe0 con 0x7efec4153ca0 2024-09-10T21:06:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.120+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efec41445a0 con 0x7efec4153ca0 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.120+0000 7f6256200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6248009e10 0x7f62480e0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f6256200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62480366f0 0x7f62480348d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f6256200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6248037690 0x7f62480d6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f6256200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f62480eba50 con 0x7f62480366f0 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f624f400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6248009e10 0x7f62480e0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f6256200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f62480eb8d0 con 0x7f6248037690 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f6256200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f62480ebbd0 con 0x7f6248009e10 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f624ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62480366f0 0x7f62480348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f624f400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6248009e10 0x7f62480e0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58464/0 (socket says 172.21.15.100:58464) 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f624f400640 1 -- 172.21.15.100:0/1526087563 learned_addr learned my addr 172.21.15.100:0/1526087563 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f624fe00640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6248037690 0x7f62480d6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.121+0000 7f3286000640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7f32600817c0 0x7f3260083c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7f624ea00640 1 -- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6248009e10 msgr2=0x7f62480e0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7f624ea00640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6248009e10 0x7f62480e0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7f624ea00640 1 -- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6248037690 msgr2=0x7f62480d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7f624ea00640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6248037690 0x7f62480d6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7f624ea00640 1 -- 172.21.15.100:0/1526087563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624804aec0 con 0x7f62480366f0 2024-09-10T21:06:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 <== osd.6 v2:172.21.15.130:6826/819652068 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f327801fe50 con 0x7f32600817c0 2024-09-10T21:06:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efec415d620 con 0x7efec4153ca0 2024-09-10T21:06:27.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7f624f400640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6248009e10 0x7f62480e0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:27.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.123+0000 7f624fe00640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6248037690 0x7f62480d6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:27.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.124+0000 7f624ea00640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62480366f0 0x7f62480348d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f623c00b3e0 tx=0x7f623c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.125+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c015020 con 0x7f62480366f0 2024-09-10T21:06:27.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.125+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f623c011920 con 0x7f62480366f0 2024-09-10T21:06:27.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.125+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62480e1560 con 0x7f62480366f0 2024-09-10T21:06:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.126+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efeb0031400 con 0x7efec4153ca0 2024-09-10T21:06:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.127+0000 7efebbe00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efea4077f70 0x7efea407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.128+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7efeb00ba7c0 con 0x7efec4153ca0 2024-09-10T21:06:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.128+0000 7efebbe00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7efea40816e0 0x7efea4083b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.128+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 --> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efeb0038e50 con 0x7efea40816e0 2024-09-10T21:06:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.128+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efeb00c1050 con 0x7efec4153ca0 2024-09-10T21:06:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.128+0000 7efec3e00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efea4077f70 0x7efea407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.129+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6248046040 con 0x7f62480366f0 2024-09-10T21:06:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.129+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c011d70 con 0x7f62480366f0 2024-09-10T21:06:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.129+0000 7efec3400640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7efea40816e0 0x7efea4083b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.130+0000 7efec3e00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efea4077f70 0x7efea407a430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efec4147030 tx=0x7efebc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.131+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f623c0193b0 con 0x7f62480366f0 2024-09-10T21:06:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.131+0000 7efec3400640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7efea40816e0 0x7efea4083b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.133+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 <== osd.7 v2:172.21.15.130:6802/351910519 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efeb0038e50 con 0x7efea40816e0 2024-09-10T21:06:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.133+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f622c001030 con 0x7f62480366f0 2024-09-10T21:06:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.133+0000 7f6243400640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6230077fc0 0x7f623007a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.134+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f623c0992a0 con 0x7f62480366f0 2024-09-10T21:06:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.134+0000 7f624f400640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6230077fc0 0x7f623007a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.135+0000 7f6243400640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f62300816b0 0x7f6230083af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.135+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 --> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f623c008eb0 con 0x7f62300816b0 2024-09-10T21:06:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.135+0000 7f624f400640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6230077fc0 0x7f623007a480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6244004450 tx=0x7f6244007ee0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.135+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f623c09e060 con 0x7f62480366f0 2024-09-10T21:06:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.136+0000 7f624fe00640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f62300816b0 0x7f6230083af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.136+0000 7f624fe00640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f62300816b0 0x7f6230083af0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.138+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 <== osd.5 v2:172.21.15.130:6810/1954625163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f623c008eb0 con 0x7f62300816b0 2024-09-10T21:06:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.138+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 --> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f472c005d50 con 0x7f47140817f0 2024-09-10T21:06:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.138+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 --> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f08a0002dd0 con 0x7f08a4081870 2024-09-10T21:06:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.139+0000 7f4731600640 1 -- 172.21.15.100:0/1973061833 <== osd.2 v2:172.21.15.100:6808/838833345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f472c005d50 con 0x7f47140817f0 2024-09-10T21:06:27.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.139+0000 7f08b7400640 1 -- 172.21.15.100:0/3980174557 <== osd.1 v2:172.21.15.100:6811/3537518613 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f08a0002dd0 con 0x7f08a4081870 2024-09-10T21:06:27.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.139+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7f08a4081870 msgr2=0x7f08a4083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.139+0000 7f08c8e00640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7f08a4081870 0x7f08a4083cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.139+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f08a4078170 msgr2=0x7f08a407a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.139+0000 7f08c8e00640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f08a4078170 0x7f08a407a630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08bc17c8b0 tx=0x7f08b8009040 comp rx=0 tx=0).stop 2024-09-10T21:06:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08bc008e90 msgr2=0x7f08bc179db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f08c8e00640 1 --2- 172.21.15.100:0/3980174557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08bc008e90 0x7f08bc179db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08c406c060 tx=0x7f08c40b47f0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f08c3e00640 1 -- 172.21.15.100:0/3980174557 reap_dead start 2024-09-10T21:06:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.139+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7f47140817f0 msgr2=0x7f4714083c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.139+0000 7f473ae00640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7f47140817f0 0x7f4714083c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 shutdown_connections 2024-09-10T21:06:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 >> 172.21.15.100:0/3980174557 conn(0x7f08bc056770 msgr2=0x7f08bc038160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4714078170 msgr2=0x7f471407a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473ae00640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4714078170 0x7f471407a630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4728034000 tx=0x7f4728004730 comp rx=0 tx=0).stop 2024-09-10T21:06:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472c0e2b30 msgr2=0x7f472c0d3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473ae00640 1 --2- 172.21.15.100:0/1973061833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f472c0e2b30 0x7f472c0d3050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4734066520 tx=0x7f473406df30 comp rx=0 tx=0).stop 2024-09-10T21:06:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473a400640 1 -- 172.21.15.100:0/1973061833 reap_dead start 2024-09-10T21:06:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 shutdown_connections 2024-09-10T21:06:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 >> 172.21.15.100:0/1973061833 conn(0x7f472c00e1e0 msgr2=0x7f472c039980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 shutdown_connections 2024-09-10T21:06:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.140+0000 7f473ae00640 1 -- 172.21.15.100:0/1973061833 wait complete. 2024-09-10T21:06:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.141+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 --> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf48002dd0 con 0x7fcf4c0817c0 2024-09-10T21:06:27.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.143+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 shutdown_connections 2024-09-10T21:06:27.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.143+0000 7f08c8e00640 1 -- 172.21.15.100:0/3980174557 wait complete. 2024-09-10T21:06:27.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.145+0000 7fcf68c00640 1 -- 172.21.15.100:0/1460434576 <== osd.0 v2:172.21.15.100:6800/2888312606 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf48002dd0 con 0x7fcf4c0817c0 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.148+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7fcf4c0817c0 msgr2=0x7fcf4c083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.148+0000 7fcf73a00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7fcf4c0817c0 0x7fcf4c083c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.148+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcf4c078040 msgr2=0x7fcf4c07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.148+0000 7fcf73a00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fcf4c078040 0x7fcf4c07a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c1f64a0 tx=0x7fcf58005cc0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.148+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf6c0cf1a0 msgr2=0x7fcf6c0af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.148+0000 7fcf73a00640 1 --2- 172.21.15.100:0/1460434576 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf6c0cf1a0 0x7fcf6c0af2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcf60031000 tx=0x7fcf60003970 comp rx=0 tx=0).stop 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.149+0000 7fcf71a00640 1 -- 172.21.15.100:0/1460434576 reap_dead start 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.149+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 shutdown_connections 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.149+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 >> 172.21.15.100:0/1460434576 conn(0x7fcf6c06cb50 msgr2=0x7fcf6c15e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.149+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 shutdown_connections 2024-09-10T21:06:27.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.151+0000 7fcf73a00640 1 -- 172.21.15.100:0/1460434576 wait complete. 2024-09-10T21:06:27.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.152+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 --> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9c00d01f0 con 0x7ff9a0081720 2024-09-10T21:06:27.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.152+0000 7ff9bd600640 1 -- 172.21.15.100:0/3760837227 <== osd.4 v2:172.21.15.130:6818/2230230044 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9c00d01f0 con 0x7ff9a0081720 2024-09-10T21:06:27.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.153+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 --> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5a4035fe0 con 0x7fb58c0817f0 2024-09-10T21:06:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.154+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7ff9a0081720 msgr2=0x7ff9a0083b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.154+0000 7ff9c6800640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7ff9a0081720 0x7ff9a0083b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9a0077fa0 msgr2=0x7ff9a007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c6800640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9a0077fa0 0x7ff9a007a460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac034000 tx=0x7ff9ac004730 comp rx=0 tx=0).stop 2024-09-10T21:06:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d4560 msgr2=0x7ff9c0160d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c6800640 1 --2- 172.21.15.100:0/3760837227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9c00d4560 0x7ff9c0160d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400e7c0 tx=0x7ff9b400ec80 comp rx=0 tx=0).stop 2024-09-10T21:06:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c5e00640 1 -- 172.21.15.100:0/3760837227 reap_dead start 2024-09-10T21:06:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 shutdown_connections 2024-09-10T21:06:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 >> 172.21.15.100:0/3760837227 conn(0x7ff9c00d3a40 msgr2=0x7ff9c00d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 shutdown_connections 2024-09-10T21:06:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7fb5a2a00640 1 -- 172.21.15.100:0/2436169862 <== osd.3 v2:172.21.15.100:6824/392814175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5a4035fe0 con 0x7fb58c0817f0 2024-09-10T21:06:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.155+0000 7ff9c6800640 1 -- 172.21.15.100:0/3760837227 wait complete. 2024-09-10T21:06:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.156+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7fb58c0817f0 msgr2=0x7fb58c083c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.157+0000 7fb5b1a00640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7fb58c0817f0 0x7fb58c083c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.157+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb58c078070 msgr2=0x7fb58c07a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.157+0000 7fb5b1a00640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb58c078070 0x7fb58c07a530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb598001c10 tx=0x7fb598009040 comp rx=0 tx=0).stop 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.157+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a4036520 msgr2=0x7fb5a404dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.157+0000 7fb5b1a00640 1 --2- 172.21.15.100:0/2436169862 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a4036520 0x7fb5a404dcb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac06b760 tx=0x7fb5ac06df30 comp rx=0 tx=0).stop 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.157+0000 7fb5ab400640 1 -- 172.21.15.100:0/2436169862 reap_dead start 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.158+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 shutdown_connections 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.158+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 >> 172.21.15.100:0/2436169862 conn(0x7fb5a4054560 msgr2=0x7fb5a40e2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.158+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 shutdown_connections 2024-09-10T21:06:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.158+0000 7fb5b1a00640 1 -- 172.21.15.100:0/2436169862 wait complete. 2024-09-10T21:06:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.160+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 --> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f325c002dd0 con 0x7f32600817c0 2024-09-10T21:06:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.161+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 --> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efec406d180 con 0x7efea40816e0 2024-09-10T21:06:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.161+0000 7f327d600640 1 -- 172.21.15.100:0/3789836110 <== osd.6 v2:172.21.15.130:6826/819652068 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f325c002dd0 con 0x7f32600817c0 2024-09-10T21:06:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.162+0000 7efebbe00640 1 -- 172.21.15.100:0/439278508 <== osd.7 v2:172.21.15.130:6802/351910519 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efec406d180 con 0x7efea40816e0 2024-09-10T21:06:27.168 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:27.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T21:06:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.163+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7f32600817c0 msgr2=0x7f3260083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.163+0000 7f3288000640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7f32600817c0 0x7f3260083c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.163+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7efea40816e0 msgr2=0x7efea4083b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.163+0000 7efecae00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7efea40816e0 0x7efea4083b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efea4077f70 msgr2=0x7efea407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7efecae00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efea4077f70 0x7efea407a430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efec4147030 tx=0x7efebc009040 comp rx=0 tx=0).stop 2024-09-10T21:06:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efec4153ca0 msgr2=0x7efec41f8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7efecae00640 1 --2- 172.21.15.100:0/439278508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efec4153ca0 0x7efec41f8200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efeb0006010 tx=0x7efeb0003820 comp rx=0 tx=0).stop 2024-09-10T21:06:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7efec8e00640 1 -- 172.21.15.100:0/439278508 reap_dead start 2024-09-10T21:06:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 shutdown_connections 2024-09-10T21:06:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3260078040 msgr2=0x7f326007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7f3288000640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3260078040 0x7f326007a500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f326c034000 tx=0x7f326c004730 comp rx=0 tx=0).stop 2024-09-10T21:06:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 msgr2=0x7f328015aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7f3288000640 1 --2- 172.21.15.100:0/3789836110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32800ceca0 0x7f328015aae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f327800ea50 tx=0x7f327800ef10 comp rx=0 tx=0).stop 2024-09-10T21:06:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.165+0000 7f3286000640 1 -- 172.21.15.100:0/3789836110 reap_dead start 2024-09-10T21:06:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.165+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 shutdown_connections 2024-09-10T21:06:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.165+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 >> 172.21.15.100:0/3789836110 conn(0x7f32800d3c50 msgr2=0x7f32800ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.164+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 >> 172.21.15.100:0/439278508 conn(0x7efec406cb50 msgr2=0x7efec40b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.165+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 shutdown_connections 2024-09-10T21:06:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.165+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 shutdown_connections 2024-09-10T21:06:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.165+0000 7efecae00640 1 -- 172.21.15.100:0/439278508 wait complete. 2024-09-10T21:06:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.165+0000 7f3288000640 1 -- 172.21.15.100:0/3789836110 wait complete. 2024-09-10T21:06:27.173 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-10T21:06:27.174 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T21:06:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.170+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 --> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f622c002dd0 con 0x7f62300816b0 2024-09-10T21:06:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.170+0000 7f6243400640 1 -- 172.21.15.100:0/1526087563 <== osd.5 v2:172.21.15.130:6810/1954625163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f622c002dd0 con 0x7f62300816b0 2024-09-10T21:06:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.171+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f62300816b0 msgr2=0x7f6230083af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.171+0000 7f6256200640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f62300816b0 0x7f6230083af0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.171+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6230077fc0 msgr2=0x7f623007a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.171+0000 7f6256200640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6230077fc0 0x7f623007a480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6244004450 tx=0x7f6244007ee0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.171+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62480366f0 msgr2=0x7f62480348d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.171+0000 7f6256200640 1 --2- 172.21.15.100:0/1526087563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62480366f0 0x7f62480348d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f623c00b3e0 tx=0x7f623c00b8a0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.172+0000 7f624fe00640 1 -- 172.21.15.100:0/1526087563 reap_dead start 2024-09-10T21:06:27.179 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-10T21:06:27.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T21:06:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.174+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 shutdown_connections 2024-09-10T21:06:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.174+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 >> 172.21.15.100:0/1526087563 conn(0x7f6248054560 msgr2=0x7f6248050f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.174+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 shutdown_connections 2024-09-10T21:06:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.174+0000 7f6256200640 1 -- 172.21.15.100:0/1526087563 wait complete. 2024-09-10T21:06:27.189 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:27.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T21:06:27.193 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:27.194 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T21:06:27.198 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:27.198 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T21:06:27.202 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-10T21:06:27.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T21:06:27.206 INFO:teuthology.orchestra.run.smithi100.stdout:55834574856 2024-09-10T21:06:27.206 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T21:06:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5cb400640 1 -- 172.21.15.100:0/2666148414 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0031c30 con 0x7fb5cc0aed80 2024-09-10T21:06:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5d3800640 1 -- 172.21.15.100:0/2666148414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc0aed80 msgr2=0x7fb5cc073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5d3800640 1 --2- 172.21.15.100:0/2666148414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc0aed80 0x7fb5cc073720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc074ba0 tx=0x7fb5c002a4b0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5d3800640 1 -- 172.21.15.100:0/2666148414 shutdown_connections 2024-09-10T21:06:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5d3800640 1 --2- 172.21.15.100:0/2666148414 >> v2:172.21.15.100:3300/0 conn(0x7fb5cc0706a0 0x7fb5cc15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5d3800640 1 --2- 172.21.15.100:0/2666148414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc0aed80 0x7fb5cc073720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5d3800640 1 -- 172.21.15.100:0/2666148414 >> 172.21.15.100:0/2666148414 conn(0x7fb5cc0b1480 msgr2=0x7fb5cc0b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5d3800640 1 -- 172.21.15.100:0/2666148414 shutdown_connections 2024-09-10T21:06:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.446+0000 7fb5d3800640 1 -- 172.21.15.100:0/2666148414 wait complete. 2024-09-10T21:06:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.449+0000 7fb5d3800640 1 Processor -- start 2024-09-10T21:06:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.449+0000 7fb5d3800640 1 -- start start 2024-09-10T21:06:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.451+0000 7fb5d3800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc06e530 0x7fb5cc14a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.451+0000 7fb5d3800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5cc0706a0 0x7fb5cc0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.451+0000 7fb5d3800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5cc0aed80 0x7fb5cc146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.451+0000 7fb5d3800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc06e9e0 con 0x7fb5cc0706a0 2024-09-10T21:06:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.451+0000 7fb5d3800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc0b21c0 con 0x7fb5cc06e530 2024-09-10T21:06:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.451+0000 7fb5d3800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb5cc06eb60 con 0x7fb5cc0aed80 2024-09-10T21:06:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.452+0000 7fb5cbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5cc0706a0 0x7fb5cc0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.452+0000 7fe231e00640 1 -- 172.21.15.100:0/376042781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c161e60 msgr2=0x7fe22c0d7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.452+0000 7fe231e00640 1 --2- 172.21.15.100:0/376042781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c161e60 0x7fe22c0d7690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0d69b0 tx=0x7fe21802a4d0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.452+0000 7fb5cbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5cc0706a0 0x7fb5cc0cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35016/0 (socket says 172.21.15.100:35016) 2024-09-10T21:06:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.452+0000 7fb5cbe00640 1 -- 172.21.15.100:0/704902438 learned_addr learned my addr 172.21.15.100:0/704902438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fe231e00640 1 -- 172.21.15.100:0/376042781 shutdown_connections 2024-09-10T21:06:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fe231e00640 1 --2- 172.21.15.100:0/376042781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c161e60 0x7fe22c0d7690 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fe231e00640 1 --2- 172.21.15.100:0/376042781 >> v2:172.21.15.100:3300/0 conn(0x7fe22c06f320 0x7fe22c0d7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fe231e00640 1 -- 172.21.15.100:0/376042781 >> 172.21.15.100:0/376042781 conn(0x7fe22c0b9af0 msgr2=0x7fe22c0b9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fb5d1800640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5cc0aed80 0x7fb5cc146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fb5d0e00640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc06e530 0x7fb5cc14a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fe231e00640 1 -- 172.21.15.100:0/376042781 shutdown_connections 2024-09-10T21:06:27.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fe231e00640 1 -- 172.21.15.100:0/376042781 wait complete. 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fb5cbe00640 1 -- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5cc0aed80 msgr2=0x7fb5cc146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fb5cbe00640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5cc0aed80 0x7fb5cc146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fb5cbe00640 1 -- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc06e530 msgr2=0x7fb5cc14a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fb5cbe00640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc06e530 0x7fb5cc14a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.453+0000 7fb5cbe00640 1 -- 172.21.15.100:0/704902438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc14a8f0 con 0x7fb5cc0706a0 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.454+0000 7fb5cbe00640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5cc0706a0 0x7fb5cc0cde60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800b4a0 tx=0x7fb5b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.455+0000 7fb5c8c00640 1 -- 172.21.15.100:0/704902438 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8014070 con 0x7fb5cc0706a0 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.455+0000 7fb5c8c00640 1 -- 172.21.15.100:0/704902438 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5b8010700 con 0x7fb5cc0706a0 2024-09-10T21:06:27.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.455+0000 7fb5c8c00640 1 -- 172.21.15.100:0/704902438 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8014070 con 0x7fb5cc0706a0 2024-09-10T21:06:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.456+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc14abd0 con 0x7fb5cc0706a0 2024-09-10T21:06:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.456+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc14b190 con 0x7fb5cc0706a0 2024-09-10T21:06:27.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.457+0000 7fe231e00640 1 Processor -- start 2024-09-10T21:06:27.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.457+0000 7fe231e00640 1 -- start start 2024-09-10T21:06:27.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.459+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a8005290 con 0x7fb5cc0706a0 2024-09-10T21:06:27.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.460+0000 7fe231e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f320 0x7fe22c0bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.460+0000 7fe231e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c161a80 0x7fe22c1fc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.460+0000 7fe231e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c161e60 0x7fe22c0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.460+0000 7fe231e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c0d28a0 con 0x7fe22c161e60 2024-09-10T21:06:27.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.460+0000 7fe231e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c0d2720 con 0x7fe22c161a80 2024-09-10T21:06:27.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.460+0000 7fe231e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe22c0d2a20 con 0x7fe22c06f320 2024-09-10T21:06:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22aa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f320 0x7fe22c0bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22aa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f320 0x7fe22c0bc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58488/0 (socket says 172.21.15.100:58488) 2024-09-10T21:06:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fb5c8c00640 1 -- 172.21.15.100:0/704902438 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb5b8021350 con 0x7fb5cc0706a0 2024-09-10T21:06:27.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22b400640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c161e60 0x7fe22c0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22b400640 1 -- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f320 msgr2=0x7fe22c0bc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22b400640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f320 0x7fe22c0bc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22b400640 1 -- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c161a80 msgr2=0x7fe22c1fc5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:06:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22b400640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c161a80 0x7fe22c1fc5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22b400640 1 -- 172.21.15.100:0/301867700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c0bd740 con 0x7fe22c161e60 2024-09-10T21:06:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.462+0000 7fe22b400640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c161e60 0x7fe22c0d0490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe218031000 tx=0x7fe218003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.461+0000 7fe22aa00640 1 -- 172.21.15.100:0/301867700 learned_addr learned my addr 172.21.15.100:0/301867700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.462+0000 7fe22aa00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f320 0x7fe22c0bc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-10T21:06:27.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.464+0000 7fb5c8c00640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb5ac0781a0 0x7fb5ac07a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.464+0000 7fb5c8c00640 1 -- 172.21.15.100:0/704902438 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb5b80998b0 con 0x7fb5cc0706a0 2024-09-10T21:06:27.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.465+0000 7fb5d0e00640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb5ac0781a0 0x7fb5ac07a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.466+0000 7fbcd7000640 1 -- 172.21.15.100:0/3093809191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 msgr2=0x7fbcc80347e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.466+0000 7fbcd7000640 1 --2- 172.21.15.100:0/3093809191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 0x7fbcc80347e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcd006b2c0 tx=0x7fbcd00a5940 comp rx=0 tx=0).stop 2024-09-10T21:06:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.466+0000 7fbcd7000640 1 -- 172.21.15.100:0/3093809191 shutdown_connections 2024-09-10T21:06:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.466+0000 7fbcd7000640 1 --2- 172.21.15.100:0/3093809191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 0x7fbcc80347e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.466+0000 7fbcd7000640 1 --2- 172.21.15.100:0/3093809191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcc8051820 0x7fbcc80547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.466+0000 7fbcd7000640 1 -- 172.21.15.100:0/3093809191 >> 172.21.15.100:0/3093809191 conn(0x7fbcc801e020 msgr2=0x7fbcc8054e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.466+0000 7fb5d0e00640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb5ac0781a0 0x7fb5ac07a660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0034000 tx=0x7fb5c0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.466+0000 7fbcd7000640 1 -- 172.21.15.100:0/3093809191 shutdown_connections 2024-09-10T21:06:27.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.467+0000 7fbcd7000640 1 -- 172.21.15.100:0/3093809191 wait complete. 2024-09-10T21:06:27.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.469+0000 7fbcd7000640 1 Processor -- start 2024-09-10T21:06:27.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.469+0000 7fbcd7000640 1 -- start start 2024-09-10T21:06:27.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.470+0000 7fe223400640 1 -- 172.21.15.100:0/301867700 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21803e030 con 0x7fe22c161e60 2024-09-10T21:06:27.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.470+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c0bda20 con 0x7fe22c161e60 2024-09-10T21:06:27.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.470+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c0bccf0 con 0x7fe22c161e60 2024-09-10T21:06:27.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.470+0000 7fe223400640 1 -- 172.21.15.100:0/301867700 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2180047a0 con 0x7fe22c161e60 2024-09-10T21:06:27.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.470+0000 7fe223400640 1 -- 172.21.15.100:0/301867700 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21803e030 con 0x7fe22c161e60 2024-09-10T21:06:27.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.471+0000 7fbcd7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc80340a0 0x7fbcc80071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.471+0000 7fbcd7000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcc8051820 0x7fbcc804e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.471+0000 7fbcd7000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 0x7fbcc804e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.471+0000 7fb5c8c00640 1 -- 172.21.15.100:0/704902438 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb5b8061fd0 con 0x7fb5cc0706a0 2024-09-10T21:06:27.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.471+0000 7fbcd7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc80366b0 con 0x7fbcc80340a0 2024-09-10T21:06:27.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.471+0000 7fbcd7000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8036530 con 0x7fbcc80e2a80 2024-09-10T21:06:27.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.471+0000 7fbcd7000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc8034d20 con 0x7fbcc8051820 2024-09-10T21:06:27.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.472+0000 7fbcd5c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc80340a0 0x7fbcc80071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.472+0000 7fbcd5200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcc8051820 0x7fbcc804e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.472+0000 7fbcd5200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcc8051820 0x7fbcc804e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58504/0 (socket says 172.21.15.100:58504) 2024-09-10T21:06:27.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.472+0000 7fbcd5200640 1 -- 172.21.15.100:0/662915601 learned_addr learned my addr 172.21.15.100:0/662915601 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.472+0000 7fbcd6600640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 0x7fbcc804e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7f6194600640 1 -- 172.21.15.100:0/3345164815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c073340 msgr2=0x7f618c0b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7f6194600640 1 --2- 172.21.15.100:0/3345164815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c073340 0x7f618c0b3870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6180005fd0 tx=0x7f618002a420 comp rx=0 tx=0).stop 2024-09-10T21:06:27.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7fbcd5200640 1 -- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 msgr2=0x7fbcc804e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7fbcd5200640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 0x7fbcc804e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7fbcd5200640 1 -- 172.21.15.100:0/662915601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc80340a0 msgr2=0x7fbcc80071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7f6194600640 1 -- 172.21.15.100:0/3345164815 shutdown_connections 2024-09-10T21:06:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7f6194600640 1 --2- 172.21.15.100:0/3345164815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0b3db0 0x7f618c0ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.474+0000 7f6194600640 1 --2- 172.21.15.100:0/3345164815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c073340 0x7f618c0b3870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.474+0000 7f6194600640 1 -- 172.21.15.100:0/3345164815 >> 172.21.15.100:0/3345164815 conn(0x7f618c06d180 msgr2=0x7f618c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7fbcd5200640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc80340a0 0x7fbcc80071a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7fbcd5200640 1 -- 172.21.15.100:0/662915601 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc8048900 con 0x7fbcc8051820 2024-09-10T21:06:27.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7fbcd6600640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 0x7fbcc804e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.473+0000 7fbcd5c00640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc80340a0 0x7fbcc80071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.474+0000 7f6194600640 1 -- 172.21.15.100:0/3345164815 shutdown_connections 2024-09-10T21:06:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.474+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe204005290 con 0x7fe22c161e60 2024-09-10T21:06:27.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.475+0000 7f6194600640 1 -- 172.21.15.100:0/3345164815 wait complete. 2024-09-10T21:06:27.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.476+0000 7fbcd5200640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcc8051820 0x7fbcc804e2c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400c400 tx=0x7fbcc400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.476+0000 7fe223400640 1 -- 172.21.15.100:0/301867700 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe218004950 con 0x7fe22c161e60 2024-09-10T21:06:27.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.478+0000 7f6194600640 1 Processor -- start 2024-09-10T21:06:27.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.477+0000 7fe223400640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe20c078170 0x7fe20c07a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.477+0000 7fe223400640 1 -- 172.21.15.100:0/301867700 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe2180ba4c0 con 0x7fe22c161e60 2024-09-10T21:06:27.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.477+0000 7fbccd600640 1 -- 172.21.15.100:0/662915601 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4017070 con 0x7fbcc8051820 2024-09-10T21:06:27.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.478+0000 7fbccd600640 1 -- 172.21.15.100:0/662915601 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcc40035f0 con 0x7fbcc8051820 2024-09-10T21:06:27.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.478+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc8048ba0 con 0x7fbcc8051820 2024-09-10T21:06:27.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.478+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc8049160 con 0x7fbcc8051820 2024-09-10T21:06:27.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.478+0000 7fbccd600640 1 -- 172.21.15.100:0/662915601 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4003a40 con 0x7fbcc8051820 2024-09-10T21:06:27.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.479+0000 7fe22aa00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe20c078170 0x7fe20c07a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.478+0000 7f6194600640 1 -- start start 2024-09-10T21:06:27.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.479+0000 7f6194600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c073340 0x7f618c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.479+0000 7f6194600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f618c0b3db0 0x7f618c1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.479+0000 7f6194600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c161650 0x7f618c145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6194600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0ae630 con 0x7f618c0b3db0 2024-09-10T21:06:27.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6194600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0ae4b0 con 0x7f618c161650 2024-09-10T21:06:27.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6194600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0ae7b0 con 0x7f618c073340 2024-09-10T21:06:27.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6192600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c161650 0x7f618c145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6191c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c073340 0x7f618c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6192600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c161650 0x7f618c145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:52800/0 (socket says 172.21.15.100:52800) 2024-09-10T21:06:27.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6192600640 1 -- 172.21.15.100:0/2839731610 learned_addr learned my addr 172.21.15.100:0/2839731610 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6191200640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f618c0b3db0 0x7f618c1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6192600640 1 -- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c073340 msgr2=0x7f618c0ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6192600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c073340 0x7f618c0ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6192600640 1 -- 172.21.15.100:0/2839731610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f618c0b3db0 msgr2=0x7f618c1452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6192600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f618c0b3db0 0x7f618c1452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.480+0000 7f6192600640 1 -- 172.21.15.100:0/2839731610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0cd370 con 0x7f618c161650 2024-09-10T21:06:27.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.481+0000 7fe22aa00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe20c078170 0x7fe20c07a630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe22c15c770 tx=0x7fe224009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.481+0000 7f6192600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c161650 0x7f618c145800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f617800d780 tx=0x7f617800dc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.481+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac005290 con 0x7fbcc8051820 2024-09-10T21:06:27.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.481+0000 7f6189600640 1 -- 172.21.15.100:0/2839731610 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178017070 con 0x7f618c161650 2024-09-10T21:06:27.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.482+0000 7f6189600640 1 -- 172.21.15.100:0/2839731610 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f617800de90 con 0x7f618c161650 2024-09-10T21:06:27.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.482+0000 7f6189600640 1 -- 172.21.15.100:0/2839731610 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178005020 con 0x7f618c161650 2024-09-10T21:06:27.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.482+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c0cd650 con 0x7f618c161650 2024-09-10T21:06:27.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.482+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c0cdc10 con 0x7f618c161650 2024-09-10T21:06:27.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.482+0000 7fbccd600640 1 -- 172.21.15.100:0/662915601 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbcc4003be0 con 0x7fbcc8051820 2024-09-10T21:06:27.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.483+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c0b3870 con 0x7f618c161650 2024-09-10T21:06:27.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.484+0000 7fbccd600640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbcb0078040 0x7fbcb007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.484+0000 7fbccd600640 1 -- 172.21.15.100:0/662915601 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbcc40995b0 con 0x7fbcc8051820 2024-09-10T21:06:27.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.484+0000 7fbcd5c00640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbcb0078040 0x7fbcb007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.486+0000 7fbcd5c00640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbcb0078040 0x7fbcb007a500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009d80 tx=0x7fbcbc0091e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.486+0000 7f6189600640 1 -- 172.21.15.100:0/2839731610 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f61780051c0 con 0x7f618c161650 2024-09-10T21:06:27.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7fc130a00640 1 -- 172.21.15.100:0/3780790796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 msgr2=0x7fc12c074230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7fc130a00640 1 --2- 172.21.15.100:0/3780790796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 0x7fc12c074230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc118009880 tx=0x7fc11802a580 comp rx=0 tx=0).stop 2024-09-10T21:06:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7fc130a00640 1 -- 172.21.15.100:0/3780790796 shutdown_connections 2024-09-10T21:06:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7fc130a00640 1 --2- 172.21.15.100:0/3780790796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 0x7fc12c074230 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7fc130a00640 1 -- 172.21.15.100:0/3780790796 >> 172.21.15.100:0/3780790796 conn(0x7fc12c06d180 msgr2=0x7fc12c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7f6189600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f616c077fa0 0x7f616c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7fe223400640 1 -- 172.21.15.100:0/301867700 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe218082c70 con 0x7fe22c161e60 2024-09-10T21:06:27.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7fc130a00640 1 -- 172.21.15.100:0/3780790796 shutdown_connections 2024-09-10T21:06:27.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7f622a200640 1 -- 172.21.15.100:0/1794113145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224070360 msgr2=0x7f62240b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.487+0000 7f622a200640 1 --2- 172.21.15.100:0/1794113145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224070360 0x7f62240b4140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62240aec00 tx=0x7f621c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7fc130a00640 1 -- 172.21.15.100:0/3780790796 wait complete. 2024-09-10T21:06:27.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7f6189600640 1 -- 172.21.15.100:0/2839731610 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f617809a5e0 con 0x7f618c161650 2024-09-10T21:06:27.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7f622a200640 1 -- 172.21.15.100:0/1794113145 shutdown_connections 2024-09-10T21:06:27.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7f622a200640 1 --2- 172.21.15.100:0/1794113145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224070360 0x7f62240b4140 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7f622a200640 1 --2- 172.21.15.100:0/1794113145 >> v2:172.21.15.130:3300/0 conn(0x7f62240b31b0 0x7f622406e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7f622a200640 1 -- 172.21.15.100:0/1794113145 >> 172.21.15.100:0/1794113145 conn(0x7f62240b1480 msgr2=0x7f62240b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7f622a200640 1 -- 172.21.15.100:0/1794113145 shutdown_connections 2024-09-10T21:06:27.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7f6191c00640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f616c077fa0 0x7f616c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.488+0000 7f622a200640 1 -- 172.21.15.100:0/1794113145 wait complete. 2024-09-10T21:06:27.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.489+0000 7fbccd600640 1 -- 172.21.15.100:0/662915601 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbcc4061790 con 0x7fbcc8051820 2024-09-10T21:06:27.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.490+0000 7f234ca00640 1 -- 172.21.15.100:0/1650020172 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 msgr2=0x7f23480b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.490+0000 7f234ca00640 1 --2- 172.21.15.100:0/1650020172 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 0x7f23480b31b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2338009830 tx=0x7f233802a3f0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.490+0000 7f6191c00640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f616c077fa0 0x7f616c07a460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f618c1614b0 tx=0x7f618400d040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.490+0000 7f234ca00640 1 -- 172.21.15.100:0/1650020172 shutdown_connections 2024-09-10T21:06:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.491+0000 7f622a200640 1 Processor -- start 2024-09-10T21:06:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.490+0000 7f234ca00640 1 --2- 172.21.15.100:0/1650020172 >> v2:172.21.15.100:3300/0 conn(0x7f2348150b70 0x7f2348073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.490+0000 7f234ca00640 1 --2- 172.21.15.100:0/1650020172 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 0x7f23480b31b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.490+0000 7f234ca00640 1 -- 172.21.15.100:0/1650020172 >> 172.21.15.100:0/1650020172 conn(0x7f23480b1480 msgr2=0x7f23480b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.491+0000 7f622a200640 1 -- start start 2024-09-10T21:06:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.491+0000 7fc130a00640 1 Processor -- start 2024-09-10T21:06:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.491+0000 7f6189600640 1 -- 172.21.15.100:0/2839731610 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6178062730 con 0x7f618c161650 2024-09-10T21:06:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.492+0000 7f234ca00640 1 -- 172.21.15.100:0/1650020172 shutdown_connections 2024-09-10T21:06:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.492+0000 7f234ca00640 1 -- 172.21.15.100:0/1650020172 wait complete. 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.492+0000 7fc130a00640 1 -- start start 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.493+0000 7fc130a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 0x7fc12c1f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.493+0000 7fc130a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc12c0b2860 0x7fc12c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc130a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc12c158530 0x7fc12c1f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc130a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c0b3400 con 0x7fc12c073df0 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc130a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c06feb0 con 0x7fc12c0b2860 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc130a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc12c0b3580 con 0x7fc12c158530 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc12a800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc12c158530 0x7fc12c1f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc129400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc12c0b2860 0x7fc12c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc12a800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc12c158530 0x7fc12c1f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58544/0 (socket says 172.21.15.100:58544) 2024-09-10T21:06:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7f622a200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6224070360 0x7f6224141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc12a800640 1 -- 172.21.15.100:0/492882524 learned_addr learned my addr 172.21.15.100:0/492882524 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.494+0000 7fc129e00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 0x7fc12c1f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f622a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62240b31b0 0x7f6224151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f622a200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6224150b70 0x7f622414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f622a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f62240b4a10 con 0x7f62240b31b0 2024-09-10T21:06:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f622a200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f62240b4890 con 0x7f6224070360 2024-09-10T21:06:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f622a200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f622415d580 con 0x7f6224150b70 2024-09-10T21:06:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6228e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6224070360 0x7f6224141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6228e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6224070360 0x7f6224141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:52826/0 (socket says 172.21.15.100:52826) 2024-09-10T21:06:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6228e00640 1 -- 172.21.15.100:0/1879048238 learned_addr learned my addr 172.21.15.100:0/1879048238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7fc12a800640 1 -- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc12c0b2860 msgr2=0x7fc12c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7fc12a800640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc12c0b2860 0x7fc12c1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f234ca00640 1 Processor -- start 2024-09-10T21:06:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6229800640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6224150b70 0x7f622414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6228e00640 1 -- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6224150b70 msgr2=0x7f622414c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6228e00640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6224150b70 0x7f622414c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6228e00640 1 -- 172.21.15.100:0/1879048238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62240b31b0 msgr2=0x7f6224151ca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:06:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6228e00640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62240b31b0 0x7f6224151ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7f6228e00640 1 -- 172.21.15.100:0/1879048238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622414bc20 con 0x7f6224070360 2024-09-10T21:06:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7fc12a800640 1 -- 172.21.15.100:0/492882524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 msgr2=0x7fc12c1f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7fc12a800640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 0x7fc12c1f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.495+0000 7fc12a800640 1 -- 172.21.15.100:0/492882524 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c155060 con 0x7fc12c158530 2024-09-10T21:06:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7f234ca00640 1 -- start start 2024-09-10T21:06:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7fc129400640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc12c0b2860 0x7fc12c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7f6228e00640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6224070360 0x7f6224141ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f621800c370 tx=0x7f621800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7fc129e00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 0x7fc12c1f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7fc12a800640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc12c158530 0x7fc12c1f4d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00c410 tx=0x7fc11c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7f6220c00640 1 -- 172.21.15.100:0/1879048238 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180052d0 con 0x7f6224070360 2024-09-10T21:06:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7f6220c00640 1 -- 172.21.15.100:0/1879048238 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6218007020 con 0x7f6224070360 2024-09-10T21:06:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7f6220c00640 1 -- 172.21.15.100:0/1879048238 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218007470 con 0x7f6224070360 2024-09-10T21:06:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62241511c0 con 0x7f6224070360 2024-09-10T21:06:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f234ca00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 0x7f2348150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f234ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2348150b70 0x7f234814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f234ca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f234815d580 0x7f23481446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f234ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f234815dda0 con 0x7f2348150b70 2024-09-10T21:06:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f233fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2348150b70 0x7f234814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f234ca00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f234815dc20 con 0x7f234815d580 2024-09-10T21:06:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f234ca00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f23481498f0 con 0x7f2348070360 2024-09-10T21:06:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f2346800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 0x7f2348150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f2346800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 0x7f2348150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58558/0 (socket says 172.21.15.100:58558) 2024-09-10T21:06:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.497+0000 7f2346800640 1 -- 172.21.15.100:0/822743760 learned_addr learned my addr 172.21.15.100:0/822743760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.496+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6224151780 con 0x7f6224070360 2024-09-10T21:06:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7fc122000640 1 -- 172.21.15.100:0/492882524 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c006890 con 0x7fc12c158530 2024-09-10T21:06:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7fc122000640 1 -- 172.21.15.100:0/492882524 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc11c006b20 con 0x7fc12c158530 2024-09-10T21:06:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7fc122000640 1 -- 172.21.15.100:0/492882524 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c007020 con 0x7fc12c158530 2024-09-10T21:06:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12c1f20d0 con 0x7fc12c158530 2024-09-10T21:06:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12c1555e0 con 0x7fc12c158530 2024-09-10T21:06:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7f2347200640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f234815d580 0x7f23481446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7f2346800640 1 -- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f234815d580 msgr2=0x7f23481446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7f2346800640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f234815d580 0x7f23481446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7f2346800640 1 -- 172.21.15.100:0/822743760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2348150b70 msgr2=0x7f234814f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7f2346800640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2348150b70 0x7f234814f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7f2346800640 1 -- 172.21.15.100:0/822743760 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2348149bd0 con 0x7f2348070360 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.499+0000 7f2346800640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 0x7f2348150330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2338000c00 tx=0x7f2338032c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.499+0000 7f233ea00640 1 -- 172.21.15.100:0/822743760 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338040070 con 0x7f2348070360 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.499+0000 7f233ea00640 1 -- 172.21.15.100:0/822743760 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2338003af0 con 0x7f2348070360 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.499+0000 7f233ea00640 1 -- 172.21.15.100:0/822743760 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338045460 con 0x7f2348070360 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.499+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2348149eb0 con 0x7f2348070360 2024-09-10T21:06:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.499+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f234814a480 con 0x7f2348070360 2024-09-10T21:06:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.498+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62240b4140 con 0x7f6224070360 2024-09-10T21:06:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.501+0000 7f6220c00640 1 -- 172.21.15.100:0/1879048238 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f62180067d0 con 0x7f6224070360 2024-09-10T21:06:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.501+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23480b31b0 con 0x7f2348070360 2024-09-10T21:06:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.502+0000 7fc3ea200640 1 -- 172.21.15.100:0/3645055615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3e415df90 msgr2=0x7fc3e40b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.502+0000 7fc3ea200640 1 --2- 172.21.15.100:0/3645055615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3e415df90 0x7fc3e40b6fe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40d3900 tx=0x7fc3dc02a8b0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.502+0000 7f233ea00640 1 -- 172.21.15.100:0/822743760 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f233804d030 con 0x7f2348070360 2024-09-10T21:06:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.500+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc12c074230 con 0x7fc12c158530 2024-09-10T21:06:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.502+0000 7fc3ea200640 1 -- 172.21.15.100:0/3645055615 shutdown_connections 2024-09-10T21:06:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.502+0000 7fc3ea200640 1 --2- 172.21.15.100:0/3645055615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3e415df90 0x7fc3e40b6fe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.502+0000 7fc3ea200640 1 --2- 172.21.15.100:0/3645055615 >> v2:172.21.15.100:3300/0 conn(0x7fc3e40d0390 0x7fc3e40b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.502+0000 7fc3ea200640 1 -- 172.21.15.100:0/3645055615 >> 172.21.15.100:0/3645055615 conn(0x7fc3e40d3c50 msgr2=0x7fc3e40d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.503+0000 7f6220c00640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6204078040 0x7f620407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.503+0000 7f6220c00640 1 -- 172.21.15.100:0/1879048238 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6218099550 con 0x7f6224070360 2024-09-10T21:06:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.503+0000 7f6223e00640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6204078040 0x7f620407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.503+0000 7f233ea00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2324078040 0x7f232407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.503+0000 7f233ea00640 1 -- 172.21.15.100:0/822743760 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f23380bb4d0 con 0x7f2348070360 2024-09-10T21:06:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.503+0000 7f233fe00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2324078040 0x7f232407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.504+0000 7f233fe00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2324078040 0x7f232407a500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23480af6e0 tx=0x7f233000b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.504+0000 7f6223e00640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6204078040 0x7f620407a500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6210005ab0 tx=0x7f6210005c10 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.505+0000 7fc3ea200640 1 -- 172.21.15.100:0/3645055615 shutdown_connections 2024-09-10T21:06:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.504+0000 7fc122000640 1 -- 172.21.15.100:0/492882524 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc11c0359c0 con 0x7fc12c158530 2024-09-10T21:06:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.506+0000 7fc122000640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc10c07c410 0x7fc10c07e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.505+0000 7fc3ea200640 1 -- 172.21.15.100:0/3645055615 wait complete. 2024-09-10T21:06:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.506+0000 7fc129e00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc10c07c410 0x7fc10c07e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.507+0000 7f6220c00640 1 -- 172.21.15.100:0/1879048238 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6218061cf0 con 0x7f6224070360 2024-09-10T21:06:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.507+0000 7fc129e00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc10c07c410 0x7fc10c07e8d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc124001da0 tx=0x7fc124009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.508+0000 7fc122000640 1 -- 172.21.15.100:0/492882524 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc11c03ab60 con 0x7fc12c158530 2024-09-10T21:06:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.508+0000 7fc3ea200640 1 Processor -- start 2024-09-10T21:06:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.508+0000 7f233ea00640 1 -- 172.21.15.100:0/822743760 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2348074490 con 0x7f2348070360 2024-09-10T21:06:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.509+0000 7fc3ea200640 1 -- start start 2024-09-10T21:06:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.510+0000 7fc3ea200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3e40cf270 0x7fc3e4160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.511+0000 7fc3ea200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3e40d0390 0x7fc3e40c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.511+0000 7fc3ea200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3e415df90 0x7fc3e4152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.511+0000 7fc3e3400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3e40cf270 0x7fc3e4160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.511+0000 7fc3e3400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3e40cf270 0x7fc3e4160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58564/0 (socket says 172.21.15.100:58564) 2024-09-10T21:06:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.511+0000 7fc3e3400640 1 -- 172.21.15.100:0/2794316119 learned_addr learned my addr 172.21.15.100:0/2794316119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:27.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.511+0000 7fc3e2a00640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3e40d0390 0x7fc3e40c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.512+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e40d2b50 con 0x7fc3e40d0390 2024-09-10T21:06:27.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.512+0000 7fc3e3e00640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3e415df90 0x7fc3e4152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.512+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e40d29d0 con 0x7fc3e415df90 2024-09-10T21:06:27.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.512+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e40d0770 con 0x7fc3e40cf270 2024-09-10T21:06:27.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.514+0000 7fc122000640 1 -- 172.21.15.100:0/492882524 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc11c0620b0 con 0x7fc12c158530 2024-09-10T21:06:27.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.513+0000 7fc3e3400640 1 -- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3e415df90 msgr2=0x7fc3e4152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.513+0000 7fc3e3400640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3e415df90 0x7fc3e4152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.513+0000 7fc3e3400640 1 -- 172.21.15.100:0/2794316119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3e40d0390 msgr2=0x7fc3e40c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.513+0000 7fc3e3400640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3e40d0390 0x7fc3e40c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.513+0000 7fc3e3400640 1 -- 172.21.15.100:0/2794316119 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e40c8530 con 0x7fc3e40cf270 2024-09-10T21:06:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.513+0000 7fc3e2a00640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3e40d0390 0x7fc3e40c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.514+0000 7fc3e3400640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3e40cf270 0x7fc3e4160840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400e9c0 tx=0x7fc3d400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.515+0000 7fc3db400640 1 -- 172.21.15.100:0/2794316119 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400cde0 con 0x7fc3e40cf270 2024-09-10T21:06:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.515+0000 7fc3db400640 1 -- 172.21.15.100:0/2794316119 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3d4004020 con 0x7fc3e40cf270 2024-09-10T21:06:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.515+0000 7fc3db400640 1 -- 172.21.15.100:0/2794316119 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4004450 con 0x7fc3e40cf270 2024-09-10T21:06:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.517+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e4157f00 con 0x7fc3e40cf270 2024-09-10T21:06:27.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.517+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e41fccf0 con 0x7fc3e40cf270 2024-09-10T21:06:27.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.522+0000 7fc3db400640 1 -- 172.21.15.100:0/2794316119 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc3d40035f0 con 0x7fc3e40cf270 2024-09-10T21:06:27.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.523+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e40d0c90 con 0x7fc3e40cf270 2024-09-10T21:06:27.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.524+0000 7fc3db400640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc3c4078040 0x7fc3c407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.524+0000 7fc3db400640 1 -- 172.21.15.100:0/2794316119 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc3d409a930 con 0x7fc3e40cf270 2024-09-10T21:06:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.525+0000 7fc3e2a00640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc3c4078040 0x7fc3c407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.526+0000 7fc3e2a00640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc3c4078040 0x7fc3c407a500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40b4a30 tx=0x7fc3d0009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.529+0000 7fc3db400640 1 -- 172.21.15.100:0/2794316119 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc3d4062b10 con 0x7fc3e40cf270 2024-09-10T21:06:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.924+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbcac005580 con 0x7fbcc8051820 2024-09-10T21:06:27.933 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:27.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.925+0000 7fbccd600640 1 -- 172.21.15.100:0/662915601 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbcc40661c0 con 0x7fbcc8051820 2024-09-10T21:06:27.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.929+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbcb0078040 msgr2=0x7fbcb007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.929+0000 7fbcd7000640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbcb0078040 0x7fbcb007a500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009d80 tx=0x7fbcbc0091e0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.929+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcc8051820 msgr2=0x7fbcc804e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.929+0000 7fbcd7000640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcc8051820 0x7fbcc804e2c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400c400 tx=0x7fbcc400c8c0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.930+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 shutdown_connections 2024-09-10T21:06:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.930+0000 7fbcd7000640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbcb0078040 0x7fbcb007a500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.930+0000 7fbcd7000640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcc80e2a80 0x7fbcc804e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.930+0000 7fbcd7000640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbcc8051820 0x7fbcc804e2c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.930+0000 7fbcd7000640 1 --2- 172.21.15.100:0/662915601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc80340a0 0x7fbcc80071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.930+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 >> 172.21.15.100:0/662915601 conn(0x7fbcc801e020 msgr2=0x7fbcc8050ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.931+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 shutdown_connections 2024-09-10T21:06:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.931+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe204005580 con 0x7fe22c161e60 2024-09-10T21:06:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.931+0000 7fbcd7000640 1 -- 172.21.15.100:0/662915601 wait complete. 2024-09-10T21:06:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.932+0000 7fe223400640 1 -- 172.21.15.100:0/301867700 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe218082570 con 0x7fe22c161e60 2024-09-10T21:06:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.934+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb5a8005580 con 0x7fb5cc0706a0 2024-09-10T21:06:27.939 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.935+0000 7fb5c8c00640 1 -- 172.21.15.100:0/704902438 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5b8097e20 con 0x7fb5cc0706a0 2024-09-10T21:06:27.940 INFO:teuthology.orchestra.run.smithi100.stdout:64424509448 2024-09-10T21:06:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.936+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe20c078170 msgr2=0x7fe20c07a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.936+0000 7fe231e00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe20c078170 0x7fe20c07a630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe22c15c770 tx=0x7fe224009040 comp rx=0 tx=0).stop 2024-09-10T21:06:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.936+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c161e60 msgr2=0x7fe22c0d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.936+0000 7fe231e00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c161e60 0x7fe22c0d0490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe218031000 tx=0x7fe218003b70 comp rx=0 tx=0).stop 2024-09-10T21:06:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.937+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 shutdown_connections 2024-09-10T21:06:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.937+0000 7fe231e00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22c161e60 0x7fe22c0d0490 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.937+0000 7fe231e00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe20c078170 0x7fe20c07a630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.937+0000 7fe231e00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c161a80 0x7fe22c1fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.937+0000 7fe231e00640 1 --2- 172.21.15.100:0/301867700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f320 0x7fe22c0bc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.937+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 >> 172.21.15.100:0/301867700 conn(0x7fe22c0b9af0 msgr2=0x7fe22c0ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.938+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 shutdown_connections 2024-09-10T21:06:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.938+0000 7fe231e00640 1 -- 172.21.15.100:0/301867700 wait complete. 2024-09-10T21:06:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.939+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb5ac0781a0 msgr2=0x7fb5ac07a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.939+0000 7fb5d3800640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb5ac0781a0 0x7fb5ac07a660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0034000 tx=0x7fb5c0004730 comp rx=0 tx=0).stop 2024-09-10T21:06:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.940+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5cc0706a0 msgr2=0x7fb5cc0cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.940+0000 7fb5d3800640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5cc0706a0 0x7fb5cc0cde60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800b4a0 tx=0x7fb5b800b960 comp rx=0 tx=0).stop 2024-09-10T21:06:27.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.940+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f618c075d40 con 0x7f618c161650 2024-09-10T21:06:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.940+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 shutdown_connections 2024-09-10T21:06:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.940+0000 7fb5d3800640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5cc0aed80 0x7fb5cc146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.941+0000 7fb5d3800640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5cc0706a0 0x7fb5cc0cde60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.941+0000 7fb5d3800640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb5ac0781a0 0x7fb5ac07a660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.941+0000 7fb5d3800640 1 --2- 172.21.15.100:0/704902438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc06e530 0x7fb5cc14a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.941+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 >> 172.21.15.100:0/704902438 conn(0x7fb5cc0b1480 msgr2=0x7fb5cc0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.941+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 shutdown_connections 2024-09-10T21:06:27.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.941+0000 7f6189600640 1 -- 172.21.15.100:0/2839731610 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6178067160 con 0x7f618c161650 2024-09-10T21:06:27.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.942+0000 7fb5d3800640 1 -- 172.21.15.100:0/704902438 wait complete. 2024-09-10T21:06:27.949 INFO:teuthology.orchestra.run.smithi100.stdout:64424509448 2024-09-10T21:06:27.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.944+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f23481599d0 con 0x7f2348070360 2024-09-10T21:06:27.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.945+0000 7f233ea00640 1 -- 172.21.15.100:0/822743760 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2338083d00 con 0x7f2348070360 2024-09-10T21:06:27.953 INFO:teuthology.orchestra.run.smithi100.stdout:64424509448 2024-09-10T21:06:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.949+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2324078040 msgr2=0x7f232407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.949+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f616c077fa0 msgr2=0x7f616c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.949+0000 7f234ca00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2324078040 0x7f232407a500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23480af6e0 tx=0x7f233000b390 comp rx=0 tx=0).stop 2024-09-10T21:06:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f616c077fa0 0x7f616c07a460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f618c1614b0 tx=0x7f618400d040 comp rx=0 tx=0).stop 2024-09-10T21:06:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c161650 msgr2=0x7f618c145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c161650 0x7f618c145800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f617800d780 tx=0x7f617800dc40 comp rx=0 tx=0).stop 2024-09-10T21:06:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.949+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 msgr2=0x7f2348150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 shutdown_connections 2024-09-10T21:06:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f616c077fa0 0x7f616c07a460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c161650 0x7f618c145800 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f618c0b3db0 0x7f618c1452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 --2- 172.21.15.100:0/2839731610 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c073340 0x7f618c0ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 >> 172.21.15.100:0/2839731610 conn(0x7f618c06d180 msgr2=0x7f618c1521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.949+0000 7f234ca00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 0x7f2348150330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2338000c00 tx=0x7f2338032c00 comp rx=0 tx=0).stop 2024-09-10T21:06:27.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 shutdown_connections 2024-09-10T21:06:27.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 shutdown_connections 2024-09-10T21:06:27.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f6194600640 1 -- 172.21.15.100:0/2839731610 wait complete. 2024-09-10T21:06:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f234ca00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2324078040 0x7f232407a500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f234ca00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f234815d580 0x7f23481446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f234ca00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2348150b70 0x7f234814f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f234ca00640 1 --2- 172.21.15.100:0/822743760 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2348070360 0x7f2348150330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.950+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 >> 172.21.15.100:0/822743760 conn(0x7f23480b1480 msgr2=0x7f234815ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.951+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 shutdown_connections 2024-09-10T21:06:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.951+0000 7f234ca00640 1 -- 172.21.15.100:0/822743760 wait complete. 2024-09-10T21:06:27.961 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.954+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f62240ceb30 con 0x7f6224070360 2024-09-10T21:06:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.955+0000 7f6220c00640 1 -- 172.21.15.100:0/1879048238 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f621806a410 con 0x7f6224070360 2024-09-10T21:06:27.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-09-10T21:06:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.960+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6204078040 msgr2=0x7f620407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.960+0000 7f622a200640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6204078040 0x7f620407a500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6210005ab0 tx=0x7f6210005c10 comp rx=0 tx=0).stop 2024-09-10T21:06:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.960+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6224070360 msgr2=0x7f6224141ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.960+0000 7f622a200640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6224070360 0x7f6224141ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f621800c370 tx=0x7f621800c830 comp rx=0 tx=0).stop 2024-09-10T21:06:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc12c158ee0 con 0x7fc12c158530 2024-09-10T21:06:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc3e40b8ed0 con 0x7fc3e40cf270 2024-09-10T21:06:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7fc122000640 1 -- 172.21.15.100:0/492882524 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc11c0619b0 con 0x7fc12c158530 2024-09-10T21:06:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7fc3db400640 1 -- 172.21.15.100:0/2794316119 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3d4067540 con 0x7fc3e40cf270 2024-09-10T21:06:27.967 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-09-10T21:06:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 shutdown_connections 2024-09-10T21:06:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7f622a200640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6224150b70 0x7f622414c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7f622a200640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62240b31b0 0x7f6224151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7f622a200640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6204078040 0x7f620407a500 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7f622a200640 1 --2- 172.21.15.100:0/1879048238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6224070360 0x7f6224141ae0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 >> 172.21.15.100:0/1879048238 conn(0x7f62240b1480 msgr2=0x7f622415da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.968 INFO:teuthology.orchestra.run.smithi100.stdout:64424509448 2024-09-10T21:06:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.962+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 shutdown_connections 2024-09-10T21:06:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.963+0000 7f622a200640 1 -- 172.21.15.100:0/1879048238 wait complete. 2024-09-10T21:06:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.965+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc10c07c410 msgr2=0x7fc10c07e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.965+0000 7fc130a00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc10c07c410 0x7fc10c07e8d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc124001da0 tx=0x7fc124009040 comp rx=0 tx=0).stop 2024-09-10T21:06:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.965+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc12c158530 msgr2=0x7fc12c1f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.965+0000 7fc130a00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc12c158530 0x7fc12c1f4d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00c410 tx=0x7fc11c00c8d0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.965+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc3c4078040 msgr2=0x7fc3c407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.965+0000 7fc3ea200640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc3c4078040 0x7fc3c407a500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40b4a30 tx=0x7fc3d0009040 comp rx=0 tx=0).stop 2024-09-10T21:06:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.965+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3e40cf270 msgr2=0x7fc3e4160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:27.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.965+0000 7fc3ea200640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3e40cf270 0x7fc3e4160840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400e9c0 tx=0x7fc3d400ee80 comp rx=0 tx=0).stop 2024-09-10T21:06:27.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-09-10T21:06:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 shutdown_connections 2024-09-10T21:06:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc130a00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc12c158530 0x7fc12c1f4d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc130a00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc10c07c410 0x7fc10c07e8d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc130a00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc12c0b2860 0x7fc12c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc130a00640 1 --2- 172.21.15.100:0/492882524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc12c073df0 0x7fc12c1f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 >> 172.21.15.100:0/492882524 conn(0x7fc12c06d180 msgr2=0x7fc12c159400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 shutdown_connections 2024-09-10T21:06:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc3ea200640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc3c4078040 0x7fc3c407a500 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc3ea200640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3e415df90 0x7fc3e4152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc3ea200640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3e40d0390 0x7fc3e40c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc3ea200640 1 --2- 172.21.15.100:0/2794316119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3e40cf270 0x7fc3e4160840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 >> 172.21.15.100:0/2794316119 conn(0x7fc3e40d3c50 msgr2=0x7fc3e40b93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 shutdown_connections 2024-09-10T21:06:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.966+0000 7fc3ea200640 1 -- 172.21.15.100:0/2794316119 wait complete. 2024-09-10T21:06:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.968+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 shutdown_connections 2024-09-10T21:06:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:27.969+0000 7fc130a00640 1 -- 172.21.15.100:0/492882524 wait complete. 2024-09-10T21:06:27.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-09-10T21:06:27.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-09-10T21:06:27.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.7 2024-09-10T21:06:27.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-09-10T21:06:27.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-09-10T21:06:27.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-09-10T21:06:28.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T21:06:28.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T21:06:28.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T21:06:28.981 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T21:06:28.984 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T21:06:28.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T21:06:28.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T21:06:28.997 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T21:06:29.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.215+0000 7f259c200640 1 -- 172.21.15.100:0/2295711416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257c003a50 msgr2=0x7f257c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.215+0000 7f259c200640 1 --2- 172.21.15.100:0/2295711416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257c003a50 0x7f257c003e50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2588006fb0 tx=0x7f257c005830 comp rx=0 tx=0).stop 2024-09-10T21:06:29.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.215+0000 7f259c200640 1 -- 172.21.15.100:0/2295711416 shutdown_connections 2024-09-10T21:06:29.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.216+0000 7f259c200640 1 --2- 172.21.15.100:0/2295711416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257c003a50 0x7f257c003e50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.216+0000 7f259c200640 1 -- 172.21.15.100:0/2295711416 >> 172.21.15.100:0/2295711416 conn(0x7f258c055530 msgr2=0x7f258c055910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.217+0000 7f259c200640 1 -- 172.21.15.100:0/2295711416 shutdown_connections 2024-09-10T21:06:29.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.218+0000 7f259c200640 1 -- 172.21.15.100:0/2295711416 wait complete. 2024-09-10T21:06:29.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.221+0000 7f259c200640 1 Processor -- start 2024-09-10T21:06:29.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.221+0000 7f259c200640 1 -- start start 2024-09-10T21:06:29.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.224+0000 7f259c200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f257c003a50 0x7f258c0debf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.224+0000 7f259c200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f258c03cd00 0x7f258c03d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.225+0000 7f259c200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c02f1d0 0x7f258c02f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.225+0000 7f2599800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f257c003a50 0x7f258c0debf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.225+0000 7f2599800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f257c003a50 0x7f258c0debf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:52872/0 (socket says 172.21.15.100:52872) 2024-09-10T21:06:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.225+0000 7f2598e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f258c03cd00 0x7f258c03d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.225+0000 7f2598e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f258c03cd00 0x7f258c03d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58572/0 (socket says 172.21.15.100:58572) 2024-09-10T21:06:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.225+0000 7f2599800640 1 -- 172.21.15.100:0/3305316330 learned_addr learned my addr 172.21.15.100:0/3305316330 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:29.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.226+0000 7f259a200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c02f1d0 0x7f258c02f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.226+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0e3e70 con 0x7f258c02f1d0 2024-09-10T21:06:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.226+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0e3cf0 con 0x7f257c003a50 2024-09-10T21:06:29.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.226+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f258c03a3f0 con 0x7f258c03cd00 2024-09-10T21:06:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.228+0000 7f259a200640 1 -- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f258c03cd00 msgr2=0x7f258c03d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.228+0000 7f259a200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f258c03cd00 0x7f258c03d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.228+0000 7f259a200640 1 -- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f257c003a50 msgr2=0x7f258c0debf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.228+0000 7f259a200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f257c003a50 0x7f258c0debf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.228+0000 7f259a200640 1 -- 172.21.15.100:0/3305316330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c178fb0 con 0x7f258c02f1d0 2024-09-10T21:06:29.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.229+0000 7f259a200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c02f1d0 0x7f258c02f660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2594000b60 tx=0x7f259406c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.229+0000 7f2591600640 1 -- 172.21.15.100:0/3305316330 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594098070 con 0x7f258c02f1d0 2024-09-10T21:06:29.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.229+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c179290 con 0x7f258c02f1d0 2024-09-10T21:06:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.230+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c179850 con 0x7f258c02f1d0 2024-09-10T21:06:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.230+0000 7f2591600640 1 -- 172.21.15.100:0/3305316330 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f259406a230 con 0x7f258c02f1d0 2024-09-10T21:06:29.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.232+0000 7f2591600640 1 -- 172.21.15.100:0/3305316330 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594098070 con 0x7f258c02f1d0 2024-09-10T21:06:29.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.233+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2570005290 con 0x7f258c02f1d0 2024-09-10T21:06:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.241+0000 7f2591600640 1 -- 172.21.15.100:0/3305316330 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2594092030 con 0x7f258c02f1d0 2024-09-10T21:06:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.242+0000 7f2591600640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2574078110 0x7f257407a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.246+0000 7f2591600640 1 -- 172.21.15.100:0/3305316330 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2594114b90 con 0x7f258c02f1d0 2024-09-10T21:06:29.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.246+0000 7f2599800640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2574078110 0x7f257407a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.248+0000 7f2591600640 1 -- 172.21.15.100:0/3305316330 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2594090070 con 0x7f258c02f1d0 2024-09-10T21:06:29.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.250+0000 7f2599800640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2574078110 0x7f257407a5d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588038040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.286+0000 7f947e400640 1 -- 172.21.15.100:0/4076213441 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f947004eb20 msgr2=0x7f947004efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.286+0000 7f947e400640 1 --2- 172.21.15.100:0/4076213441 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f947004eb20 0x7f947004efd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f947806b2c0 tx=0x7f94780a59c0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.286+0000 7f947e400640 1 -- 172.21.15.100:0/4076213441 shutdown_connections 2024-09-10T21:06:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.286+0000 7f947e400640 1 --2- 172.21.15.100:0/4076213441 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f947004eb20 0x7f947004efd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.286+0000 7f947e400640 1 --2- 172.21.15.100:0/4076213441 >> v2:172.21.15.130:3300/0 conn(0x7f9470054f10 0x7f94700399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.286+0000 7f947e400640 1 -- 172.21.15.100:0/4076213441 >> 172.21.15.100:0/4076213441 conn(0x7f947001d770 msgr2=0x7f9470054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.287+0000 7f947e400640 1 -- 172.21.15.100:0/4076213441 shutdown_connections 2024-09-10T21:06:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.287+0000 7f947e400640 1 -- 172.21.15.100:0/4076213441 wait complete. 2024-09-10T21:06:29.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.289+0000 7f947e400640 1 Processor -- start 2024-09-10T21:06:29.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.290+0000 7f947e400640 1 -- start start 2024-09-10T21:06:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.291+0000 7f947e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f947004eb20 0x7f94700520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.291+0000 7f947e400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9470054f10 0x7f94700525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.291+0000 7f947e400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94700e0ac0 0x7f947004bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.291+0000 7f947e400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9470007100 con 0x7f947004eb20 2024-09-10T21:06:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.291+0000 7f947e400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f947003a110 con 0x7f9470054f10 2024-09-10T21:06:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.291+0000 7f947e400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f947004f510 con 0x7f94700e0ac0 2024-09-10T21:06:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.293+0000 7f9477e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9470054f10 0x7f94700525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.294+0000 7f947d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f947004eb20 0x7f94700520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.295+0000 7f2ef6c00640 1 -- 172.21.15.100:0/2102804504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee80e2790 msgr2=0x7f2ee80e6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.295+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/2102804504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee80e2790 0x7f2ee80e6420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800f240 tx=0x7f2edc02a4d0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.294+0000 7f947d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f947004eb20 0x7f94700520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35146/0 (socket says 172.21.15.100:35146) 2024-09-10T21:06:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.294+0000 7f947d000640 1 -- 172.21.15.100:0/3960079161 learned_addr learned my addr 172.21.15.100:0/3960079161 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.295+0000 7f947da00640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94700e0ac0 0x7f947004bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.295+0000 7f947d000640 1 -- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94700e0ac0 msgr2=0x7f947004bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f947d000640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94700e0ac0 0x7f947004bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f947d000640 1 -- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9470054f10 msgr2=0x7f94700525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f947d000640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9470054f10 0x7f94700525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f947d000640 1 -- 172.21.15.100:0/3960079161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9470052c60 con 0x7f947004eb20 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f2ef6c00640 1 -- 172.21.15.100:0/2102804504 shutdown_connections 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/2102804504 >> v2:172.21.15.130:3300/0 conn(0x7f2ee803b930 0x7f2ee80066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/2102804504 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ee8037f00 0x7f2ee80e6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/2102804504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee80e2790 0x7f2ee80e6420 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f2ef6c00640 1 -- 172.21.15.100:0/2102804504 >> 172.21.15.100:0/2102804504 conn(0x7f2ee803a3c0 msgr2=0x7f2ee803a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f947da00640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94700e0ac0 0x7f947004bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f9477e00640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9470054f10 0x7f94700525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f947d000640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f947004eb20 0x7f94700520a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f946c00c3c0 tx=0x7f946c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f9474c00640 1 -- 172.21.15.100:0/3960079161 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c011790 con 0x7f947004eb20 2024-09-10T21:06:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.297+0000 7f9474c00640 1 -- 172.21.15.100:0/3960079161 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f946c017070 con 0x7f947004eb20 2024-09-10T21:06:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.298+0000 7f9474c00640 1 -- 172.21.15.100:0/3960079161 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c011ca0 con 0x7f947004eb20 2024-09-10T21:06:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.298+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9470052f40 con 0x7f947004eb20 2024-09-10T21:06:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.298+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9470053500 con 0x7f947004eb20 2024-09-10T21:06:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.298+0000 7f2ef6c00640 1 -- 172.21.15.100:0/2102804504 shutdown_connections 2024-09-10T21:06:29.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.298+0000 7f2ef6c00640 1 -- 172.21.15.100:0/2102804504 wait complete. 2024-09-10T21:06:29.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.298+0000 7fea1e400640 1 -- 172.21.15.100:0/323993420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 msgr2=0x7fea180ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.298+0000 7fea1e400640 1 --2- 172.21.15.100:0/323993420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 0x7fea180ce5c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea1808ce40 tx=0x7fea0802a5f0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.299+0000 7fea1e400640 1 -- 172.21.15.100:0/323993420 shutdown_connections 2024-09-10T21:06:29.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.299+0000 7fea1e400640 1 --2- 172.21.15.100:0/323993420 >> v2:172.21.15.100:3300/0 conn(0x7fea18162110 0x7fea180ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.299+0000 7fea1e400640 1 --2- 172.21.15.100:0/323993420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 0x7fea180ce5c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.299+0000 7fea1e400640 1 -- 172.21.15.100:0/323993420 >> 172.21.15.100:0/323993420 conn(0x7fea180d3a40 msgr2=0x7fea180d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.299+0000 7fea1e400640 1 -- 172.21.15.100:0/323993420 shutdown_connections 2024-09-10T21:06:29.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.299+0000 7fea1e400640 1 -- 172.21.15.100:0/323993420 wait complete. 2024-09-10T21:06:29.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.300+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f947004efd0 con 0x7f947004eb20 2024-09-10T21:06:29.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.301+0000 7f2ef6c00640 1 Processor -- start 2024-09-10T21:06:29.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.302+0000 7f2ef6c00640 1 -- start start 2024-09-10T21:06:29.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.302+0000 7fea1e400640 1 Processor -- start 2024-09-10T21:06:29.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.302+0000 7fea1e400640 1 -- start start 2024-09-10T21:06:29.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea1e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea1815daa0 0x7fea18147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea1e400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 0x7fea180b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea1e400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea18162110 0x7fea180caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7f2ef6c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ee8037f00 0x7f2ee804f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea1e400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fea180cf040 con 0x7fea1815daa0 2024-09-10T21:06:29.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7f2ef6c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ee803b930 0x7f2ee804ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea1e400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea180b2b30 con 0x7fea18161cb0 2024-09-10T21:06:29.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea1e400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fea180cf1c0 con 0x7fea18162110 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea16a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 0x7fea180b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea16a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 0x7fea180b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:52908/0 (socket says 172.21.15.100:52908) 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fea16a00640 1 -- 172.21.15.100:0/4192140420 learned_addr learned my addr 172.21.15.100:0/4192140420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea17e00640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea18162110 0x7fea180caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea16a00640 1 -- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea18162110 msgr2=0x7fea180caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea17400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea1815daa0 0x7fea18147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea16a00640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea18162110 0x7fea180caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea16a00640 1 -- 172.21.15.100:0/4192140420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea1815daa0 msgr2=0x7fea18147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.306+0000 7f9474c00640 1 -- 172.21.15.100:0/3960079161 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f946c01c460 con 0x7f947004eb20 2024-09-10T21:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7f2eefe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ee8037f00 0x7f2ee804f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea16a00640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea1815daa0 0x7fea18147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea16a00640 1 -- 172.21.15.100:0/4192140420 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea180cd9e0 con 0x7fea18161cb0 2024-09-10T21:06:29.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.306+0000 7f2eefe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ee8037f00 0x7f2ee804f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:52920/0 (socket says 172.21.15.100:52920) 2024-09-10T21:06:29.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea17e00640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea18162110 0x7fea180caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:29.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.305+0000 7fea17400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea1815daa0 0x7fea18147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:29.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.306+0000 7f2eefe00640 1 -- 172.21.15.100:0/748209647 learned_addr learned my addr 172.21.15.100:0/748209647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:29.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee80e2790 0x7f2ee817cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fca49e00640 1 -- 172.21.15.100:0/224944442 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 msgr2=0x7fca44070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fca49e00640 1 --2- 172.21.15.100:0/224944442 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 0x7fca44070980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca34009860 tx=0x7fca3402a460 comp rx=0 tx=0).stop 2024-09-10T21:06:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fca49e00640 1 -- 172.21.15.100:0/224944442 shutdown_connections 2024-09-10T21:06:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fca49e00640 1 --2- 172.21.15.100:0/224944442 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 0x7fca44070980 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fca49e00640 1 -- 172.21.15.100:0/224944442 >> 172.21.15.100:0/224944442 conn(0x7fca4406dc60 msgr2=0x7fca4406e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fca49e00640 1 -- 172.21.15.100:0/224944442 shutdown_connections 2024-09-10T21:06:29.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7fea16a00640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 0x7fea180b5f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea08009850 tx=0x7fea080038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.304+0000 7fca49e00640 1 -- 172.21.15.100:0/224944442 wait complete. 2024-09-10T21:06:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7fca49e00640 1 Processor -- start 2024-09-10T21:06:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8006fb0 con 0x7f2ee80e2790 2024-09-10T21:06:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7fca49e00640 1 -- start start 2024-09-10T21:06:29.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8006e30 con 0x7f2ee8037f00 2024-09-10T21:06:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7fea0f400640 1 -- 172.21.15.100:0/4192140420 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0803f070 con 0x7fea18161cb0 2024-09-10T21:06:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7fea0f400640 1 -- 172.21.15.100:0/4192140420 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea080047a0 con 0x7fea18161cb0 2024-09-10T21:06:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee8007130 con 0x7f2ee803b930 2024-09-10T21:06:29.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7f2eef400640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ee803b930 0x7f2ee804ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.307+0000 7fea0f400640 1 -- 172.21.15.100:0/4192140420 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08035030 con 0x7fea18161cb0 2024-09-10T21:06:29.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1815b170 con 0x7fea18161cb0 2024-09-10T21:06:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7f2eefe00640 1 -- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ee803b930 msgr2=0x7f2ee804ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7f2eefe00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ee803b930 0x7f2ee804ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7f2eefe00640 1 -- 172.21.15.100:0/748209647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee80e2790 msgr2=0x7f2ee817cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7f2eefe00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee80e2790 0x7f2ee817cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7f2eefe00640 1 -- 172.21.15.100:0/748209647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee80dfa10 con 0x7f2ee8037f00 2024-09-10T21:06:29.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1815b730 con 0x7fea18161cb0 2024-09-10T21:06:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fa435000640 1 -- 172.21.15.100:0/1729011244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4300afd10 msgr2=0x7fa43006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fa435000640 1 --2- 172.21.15.100:0/1729011244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4300afd10 0x7fa43006f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa420009900 tx=0x7fa42002a5b0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fa435000640 1 -- 172.21.15.100:0/1729011244 shutdown_connections 2024-09-10T21:06:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fa435000640 1 --2- 172.21.15.100:0/1729011244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4300afd10 0x7fa43006f320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fa435000640 1 -- 172.21.15.100:0/1729011244 >> 172.21.15.100:0/1729011244 conn(0x7fa43006dc60 msgr2=0x7fa43006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.311+0000 7f2eefe00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ee8037f00 0x7f2ee804f910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0098b0 tx=0x7f2edc030650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.311+0000 7fa435000640 1 -- 172.21.15.100:0/1729011244 shutdown_connections 2024-09-10T21:06:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.311+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea1815b930 con 0x7fea18161cb0 2024-09-10T21:06:29.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.311+0000 7fa435000640 1 -- 172.21.15.100:0/1729011244 wait complete. 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7fca49e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca44070ec0 0x7fca44144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.308+0000 7fca49e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca44147070 0x7fca44145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fca49e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 0x7fca440b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fca49e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca44073eb0 con 0x7fca44070ec0 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fca49e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca44073d30 con 0x7fca44147070 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fca49e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fca44074030 con 0x7fca44147450 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fca43400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 0x7fca440b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fca43400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 0x7fca440b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.100:58626/0 (socket says 172.21.15.100:58626) 2024-09-10T21:06:29.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fca43400640 1 -- 172.21.15.100:0/4015853385 learned_addr learned my addr 172.21.15.100:0/4015853385 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.309+0000 7fca42000640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca44147070 0x7fca44145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fca43400640 1 -- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca44147070 msgr2=0x7fca44145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fca43400640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca44147070 0x7fca44145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fca43400640 1 -- 172.21.15.100:0/4015853385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca44070ec0 msgr2=0x7fca44144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fca43400640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca44070ec0 0x7fca44144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fca43400640 1 -- 172.21.15.100:0/4015853385 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4413a760 con 0x7fca44147450 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7fca42000640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca44147070 0x7fca44145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.311+0000 7fca43400640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 0x7fca440b2410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00c7b0 tx=0x7fca3c00cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.312+0000 7fca3b400640 1 -- 172.21.15.100:0/4015853385 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c017070 con 0x7fca44147450 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.312+0000 7fca3b400640 1 -- 172.21.15.100:0/4015853385 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca3c005070 con 0x7fca44147450 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.312+0000 7fca3b400640 1 -- 172.21.15.100:0/4015853385 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00ce60 con 0x7fca44147450 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.312+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4413aaa0 con 0x7fca44147450 2024-09-10T21:06:29.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.312+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4413b2e0 con 0x7fca44147450 2024-09-10T21:06:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.313+0000 7f2ee3e00640 1 -- 172.21.15.100:0/748209647 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc040070 con 0x7f2ee8037f00 2024-09-10T21:06:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.313+0000 7fea0f400640 1 -- 172.21.15.100:0/4192140420 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fea08004bb0 con 0x7fea18161cb0 2024-09-10T21:06:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7f9474c00640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9458077f70 0x7f945807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.310+0000 7f9474c00640 1 -- 172.21.15.100:0/3960079161 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f946c099f10 con 0x7f947004eb20 2024-09-10T21:06:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.311+0000 7f9477e00640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9458077f70 0x7f945807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.312+0000 7f9477e00640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9458077f70 0x7f945807a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94640058c0 tx=0x7f9464005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.314+0000 7f9474c00640 1 -- 172.21.15.100:0/3960079161 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f946c0625b0 con 0x7f947004eb20 2024-09-10T21:06:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.314+0000 7fea0f400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe9f8077fc0 0x7fe9f807a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.313+0000 7f2ee3e00640 1 -- 172.21.15.100:0/748209647 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2edc030c50 con 0x7f2ee8037f00 2024-09-10T21:06:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.313+0000 7f2ee3e00640 1 -- 172.21.15.100:0/748209647 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc004280 con 0x7f2ee8037f00 2024-09-10T21:06:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.313+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee80dfc80 con 0x7f2ee8037f00 2024-09-10T21:06:29.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.314+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee80e0240 con 0x7f2ee8037f00 2024-09-10T21:06:29.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7fea0f400640 1 -- 172.21.15.100:0/4192140420 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fea080bafd0 con 0x7fea18161cb0 2024-09-10T21:06:29.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7f7107200640 1 -- 172.21.15.100:0/1889197546 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec004800 msgr2=0x7f70ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7f7107200640 1 --2- 172.21.15.100:0/1889197546 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec004800 0x7f70ec004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70f40099a0 tx=0x7f70ec005830 comp rx=0 tx=0).stop 2024-09-10T21:06:29.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7fa435000640 1 Processor -- start 2024-09-10T21:06:29.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7fea17400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe9f8077fc0 0x7fe9f807a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca44070980 con 0x7fca44147450 2024-09-10T21:06:29.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7f7107200640 1 -- 172.21.15.100:0/1889197546 shutdown_connections 2024-09-10T21:06:29.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7f7107200640 1 --2- 172.21.15.100:0/1889197546 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec004800 0x7f70ec004c80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7f7107200640 1 -- 172.21.15.100:0/1889197546 >> 172.21.15.100:0/1889197546 conn(0x7f71080d3a40 msgr2=0x7f71080d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7fa435000640 1 -- start start 2024-09-10T21:06:29.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.316+0000 7f7107200640 1 -- 172.21.15.100:0/1889197546 shutdown_connections 2024-09-10T21:06:29.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.315+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee80e0440 con 0x7f2ee8037f00 2024-09-10T21:06:29.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.316+0000 7fea17400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe9f8077fc0 0x7fe9f807a480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea10001e10 tx=0x7fea10009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.316+0000 7fca3b400640 1 -- 172.21.15.100:0/4015853385 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fca3c0054c0 con 0x7fca44147450 2024-09-10T21:06:29.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7f7107200640 1 -- 172.21.15.100:0/1889197546 wait complete. 2024-09-10T21:06:29.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa435000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa43006d260 0x7fa430157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa435000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4300afd10 0x7fa43014e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa435000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa430161e50 0x7fa4300ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa435000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300b3aa0 con 0x7fa43006d260 2024-09-10T21:06:29.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa435000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300b3920 con 0x7fa4300afd10 2024-09-10T21:06:29.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa435000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa4300d0f80 con 0x7fa430161e50 2024-09-10T21:06:29.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fca3b400640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fca24078040 0x7fca2407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa42f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa43006d260 0x7fa430157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa42f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa43006d260 0x7fa430157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35198/0 (socket says 172.21.15.100:35198) 2024-09-10T21:06:29.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa42f400640 1 -- 172.21.15.100:0/1267540569 learned_addr learned my addr 172.21.15.100:0/1267540569 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:29.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fca3b400640 1 -- 172.21.15.100:0/4015853385 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fca3c099a00 con 0x7fca44147450 2024-09-10T21:06:29.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fca42a00640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fca24078040 0x7fca2407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa42fe00640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa430161e50 0x7fa4300ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.317+0000 7fa42ea00640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4300afd10 0x7fa43014e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.318+0000 7fa42f400640 1 -- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa430161e50 msgr2=0x7fa4300ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.318+0000 7fa42f400640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa430161e50 0x7fa4300ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.318+0000 7fa42f400640 1 -- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4300afd10 msgr2=0x7fa43014e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.318+0000 7fa42f400640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4300afd10 0x7fa43014e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.318+0000 7fa42f400640 1 -- 172.21.15.100:0/1267540569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa430155d50 con 0x7fa43006d260 2024-09-10T21:06:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.318+0000 7fa42f400640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa43006d260 0x7fa430157050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa420000c00 tx=0x7fa420003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.318+0000 7fca42a00640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fca24078040 0x7fca2407a500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca30007fd0 tx=0x7fca30007900 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.319+0000 7f7107200640 1 Processor -- start 2024-09-10T21:06:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.319+0000 7f7107200640 1 -- start start 2024-09-10T21:06:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.319+0000 7fa427400640 1 -- 172.21.15.100:0/1267540569 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42003f070 con 0x7fa43006d260 2024-09-10T21:06:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.319+0000 7fa427400640 1 -- 172.21.15.100:0/1267540569 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa420004a90 con 0x7fa43006d260 2024-09-10T21:06:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.319+0000 7fea0f400640 1 -- 172.21.15.100:0/4192140420 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fea1815b930 con 0x7fea18161cb0 2024-09-10T21:06:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.319+0000 7fa427400640 1 -- 172.21.15.100:0/1267540569 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420035030 con 0x7fa43006d260 2024-09-10T21:06:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.320+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa430156570 con 0x7fa43006d260 2024-09-10T21:06:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.321+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4300aef10 con 0x7fa43006d260 2024-09-10T21:06:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.322+0000 7f7107200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec004800 0x7f710814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.322+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4300d1450 con 0x7fa43006d260 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.322+0000 7f7107200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71081f9710 0x7f71080b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.322+0000 7f7107200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71080b7de0 0x7f710815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.322+0000 7f7107200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7108161db0 con 0x7f70ec004800 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.322+0000 7f7107200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7108161c30 con 0x7f71081f9710 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.322+0000 7f7107200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7108161f30 con 0x7f71080b7de0 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.323+0000 7f7105e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec004800 0x7f710814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.323+0000 7f7105e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec004800 0x7f710814ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35200/0 (socket says 172.21.15.100:35200) 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.323+0000 7f7105e00640 1 -- 172.21.15.100:0/2413208050 learned_addr learned my addr 172.21.15.100:0/2413208050 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.323+0000 7f2ee3e00640 1 -- 172.21.15.100:0/748209647 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2edc04c070 con 0x7f2ee8037f00 2024-09-10T21:06:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.323+0000 7f7105400640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71081f9710 0x7f71080b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.324+0000 7fc709800640 1 -- 172.21.15.100:0/4001294888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 msgr2=0x7fc7040d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.324+0000 7fc709800640 1 --2- 172.21.15.100:0/4001294888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 0x7fc7040d2680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc005fd0 tx=0x7fc6fc02a8b0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.324+0000 7fca3b400640 1 -- 172.21.15.100:0/4015853385 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fca4413aaa0 con 0x7fca44147450 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7f2ee3e00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2ed0078040 0x7f2ed007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.324+0000 7f7106800640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71080b7de0 0x7f710815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.324+0000 7f7105400640 1 -- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71080b7de0 msgr2=0x7f710815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.324+0000 7f7105400640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71080b7de0 0x7f710815e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.324+0000 7f7105400640 1 -- 172.21.15.100:0/2413208050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec004800 msgr2=0x7f710814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7f7105400640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec004800 0x7f710814ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7f7105400640 1 -- 172.21.15.100:0/2413208050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71081f9b70 con 0x7f71081f9710 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7f7106800640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71080b7de0 0x7f710815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7f7105e00640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec004800 0x7f710814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7f2ee3e00640 1 -- 172.21.15.100:0/748209647 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2edc0bb640 con 0x7f2ee8037f00 2024-09-10T21:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.326+0000 7f2ee3e00640 1 -- 172.21.15.100:0/748209647 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2ee80e0440 con 0x7f2ee8037f00 2024-09-10T21:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.326+0000 7f2eef400640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2ed0078040 0x7f2ed007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7fa427400640 1 -- 172.21.15.100:0/1267540569 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa420004ea0 con 0x7fa43006d260 2024-09-10T21:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7fc709800640 1 -- 172.21.15.100:0/4001294888 shutdown_connections 2024-09-10T21:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7fc709800640 1 --2- 172.21.15.100:0/4001294888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 0x7fc7040d2680 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7fc709800640 1 --2- 172.21.15.100:0/4001294888 >> v2:172.21.15.130:3300/0 conn(0x7fc70415ddb0 0x7fc7040d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.325+0000 7fc709800640 1 -- 172.21.15.100:0/4001294888 >> 172.21.15.100:0/4001294888 conn(0x7fc7040d3c30 msgr2=0x7fc7040d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.327+0000 7f2eef400640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2ed0078040 0x7f2ed007a500 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80cea90 tx=0x7f2ee4009260 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.326+0000 7fa427400640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa410078040 0x7fa41007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.326+0000 7fa427400640 1 -- 172.21.15.100:0/1267540569 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa4200bb140 con 0x7fa43006d260 2024-09-10T21:06:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.327+0000 7f7105400640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71081f9710 0x7f71080b78a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70f4031000 tx=0x7f70f4032de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.327+0000 7fa42ea00640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa410078040 0x7fa41007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.329+0000 7fc709800640 1 -- 172.21.15.100:0/4001294888 shutdown_connections 2024-09-10T21:06:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.330+0000 7f70fe000640 1 -- 172.21.15.100:0/2413208050 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4041020 con 0x7f71081f9710 2024-09-10T21:06:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.330+0000 7f70fe000640 1 -- 172.21.15.100:0/2413208050 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70f403d760 con 0x7f71081f9710 2024-09-10T21:06:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.330+0000 7f70fe000640 1 -- 172.21.15.100:0/2413208050 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4037040 con 0x7f71081f9710 2024-09-10T21:06:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.330+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71080b6e00 con 0x7f71081f9710 2024-09-10T21:06:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.330+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71080b70a0 con 0x7f71081f9710 2024-09-10T21:06:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.330+0000 7fa42ea00640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa410078040 0x7fa41007a500 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4301f2290 tx=0x7fa41c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.331+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71081544a0 con 0x7f71081f9710 2024-09-10T21:06:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.333+0000 7f70fe000640 1 -- 172.21.15.100:0/2413208050 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f70f404e060 con 0x7f71081f9710 2024-09-10T21:06:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.334+0000 7fa427400640 1 -- 172.21.15.100:0/1267540569 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa420083320 con 0x7fa43006d260 2024-09-10T21:06:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.333+0000 7fc709800640 1 -- 172.21.15.100:0/4001294888 wait complete. 2024-09-10T21:06:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.335+0000 7f70fe000640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70e8077fa0 0x7f70e807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.336+0000 7f70fe000640 1 -- 172.21.15.100:0/2413208050 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f70f40ba940 con 0x7f71081f9710 2024-09-10T21:06:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.336+0000 7fc709800640 1 Processor -- start 2024-09-10T21:06:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.337+0000 7f7105e00640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70e8077fa0 0x7f70e807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.337+0000 7f7105e00640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70e8077fa0 0x7f70e807a460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70f8001b50 tx=0x7f70f8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.337+0000 7fc709800640 1 -- start start 2024-09-10T21:06:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.338+0000 7fc709800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7040d10b0 0x7fc704073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.338+0000 7fc709800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 0x7fc704200ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.338+0000 7fc709800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc70415ddb0 0x7fc7040c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.338+0000 7fc709800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040b6c00 con 0x7fc7040d10b0 2024-09-10T21:06:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.338+0000 7fc709800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040b6a80 con 0x7fc70415ddb0 2024-09-10T21:06:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.338+0000 7fc709800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc7040b6d80 con 0x7fc7040d21f0 2024-09-10T21:06:29.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.339+0000 7fc703400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc70415ddb0 0x7fc7040c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.339+0000 7f70fe000640 1 -- 172.21.15.100:0/2413208050 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f70f4087440 con 0x7f71081f9710 2024-09-10T21:06:29.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.339+0000 7fc6fbe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 0x7fc704200ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.339+0000 7fc703400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc70415ddb0 0x7fc7040c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:52984/0 (socket says 172.21.15.100:52984) 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.339+0000 7fc703400640 1 -- 172.21.15.100:0/3817717897 learned_addr learned my addr 172.21.15.100:0/3817717897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.339+0000 7fc702a00640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7040d10b0 0x7fc704073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.340+0000 7fc6fbe00640 1 -- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc70415ddb0 msgr2=0x7fc7040c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.340+0000 7fc6fbe00640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc70415ddb0 0x7fc7040c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.340+0000 7fc6fbe00640 1 -- 172.21.15.100:0/3817717897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7040d10b0 msgr2=0x7fc704073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.340+0000 7fc6fbe00640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7040d10b0 0x7fc704073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.340+0000 7fc6fbe00640 1 -- 172.21.15.100:0/3817717897 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7040728b0 con 0x7fc7040d21f0 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.341+0000 7fc703400640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc70415ddb0 0x7fc7040c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:29.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.341+0000 7fc6fbe00640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 0x7fc704200ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00c3f0 tx=0x7fc6ec00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.342+0000 7fc6faa00640 1 -- 172.21.15.100:0/3817717897 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec011790 con 0x7fc7040d21f0 2024-09-10T21:06:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.342+0000 7fc6faa00640 1 -- 172.21.15.100:0/3817717897 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6ec017070 con 0x7fc7040d21f0 2024-09-10T21:06:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.342+0000 7fc6faa00640 1 -- 172.21.15.100:0/3817717897 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec011ce0 con 0x7fc7040d21f0 2024-09-10T21:06:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.342+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc704072b90 con 0x7fc7040d21f0 2024-09-10T21:06:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.342+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc704073bb0 con 0x7fc7040d21f0 2024-09-10T21:06:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.344+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7040d2680 con 0x7fc7040d21f0 2024-09-10T21:06:29.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.350+0000 7fc6faa00640 1 -- 172.21.15.100:0/3817717897 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc6ec01c460 con 0x7fc7040d21f0 2024-09-10T21:06:29.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.351+0000 7fc6faa00640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc6e0077fc0 0x7fc6e007a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:29.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.352+0000 7fc6faa00640 1 -- 172.21.15.100:0/3817717897 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc6ec05e110 con 0x7fc7040d21f0 2024-09-10T21:06:29.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.352+0000 7fc702a00640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc6e0077fc0 0x7fc6e007a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:29.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.353+0000 7fc702a00640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc6e0077fc0 0x7fc6e007a480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400b810 tx=0x7fc6f4008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:29.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.358+0000 7fc6faa00640 1 -- 172.21.15.100:0/3817717897 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc6ec0625a0 con 0x7fc7040d21f0 2024-09-10T21:06:29.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.658+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2570005850 con 0x7f258c02f1d0 2024-09-10T21:06:29.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.663+0000 7f2591600640 1 -- 172.21.15.100:0/3305316330 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f25940dcd70 con 0x7f258c02f1d0 2024-09-10T21:06:29.671 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-10T21:06:29.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.667+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2574078110 msgr2=0x7f257407a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.667+0000 7f259c200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2574078110 0x7f257407a5d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588038040 comp rx=0 tx=0).stop 2024-09-10T21:06:29.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.667+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c02f1d0 msgr2=0x7f258c02f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.667+0000 7f259c200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c02f1d0 0x7f258c02f660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2594000b60 tx=0x7f259406c8d0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.668+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 shutdown_connections 2024-09-10T21:06:29.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.668+0000 7f259c200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c02f1d0 0x7f258c02f660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.668+0000 7f259c200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f258c03cd00 0x7f258c03d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.668+0000 7f259c200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2574078110 0x7f257407a5d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.668+0000 7f259c200640 1 --2- 172.21.15.100:0/3305316330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f257c003a50 0x7f258c0debf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.668+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 >> 172.21.15.100:0/3305316330 conn(0x7f258c055530 msgr2=0x7f258c00e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.669+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 shutdown_connections 2024-09-10T21:06:29.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.669+0000 7f259c200640 1 -- 172.21.15.100:0/3305316330 wait complete. 2024-09-10T21:06:29.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-10T21:06:29.701 DEBUG:teuthology.parallel:result is None 2024-09-10T21:06:29.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.730+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7108074060 con 0x7f71081f9710 2024-09-10T21:06:29.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.731+0000 7f70fe000640 1 -- 172.21.15.100:0/2413208050 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70f408be60 con 0x7f71081f9710 2024-09-10T21:06:29.735 INFO:teuthology.orchestra.run.smithi100.stdout:55834574857 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70e8077fa0 msgr2=0x7f70e807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70e8077fa0 0x7f70e807a460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70f8001b50 tx=0x7f70f8009040 comp rx=0 tx=0).stop 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71081f9710 msgr2=0x7f71080b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71081f9710 0x7f71080b78a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70f4031000 tx=0x7f70f4032de0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 shutdown_connections 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71080b7de0 0x7f710815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f70e8077fa0 0x7f70e807a460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71081f9710 0x7f71080b78a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 --2- 172.21.15.100:0/2413208050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70ec004800 0x7f710814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 >> 172.21.15.100:0/2413208050 conn(0x7f71080d3a40 msgr2=0x7f710806e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.733+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 shutdown_connections 2024-09-10T21:06:29.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.734+0000 7f7107200640 1 -- 172.21.15.100:0/2413208050 wait complete. 2024-09-10T21:06:29.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.747+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fea180cf750 con 0x7fea18161cb0 2024-09-10T21:06:29.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.747+0000 7fea0f400640 1 -- 172.21.15.100:0/4192140420 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea08083900 con 0x7fea18161cb0 2024-09-10T21:06:29.752 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:29.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.5 2024-09-10T21:06:29.754 DEBUG:teuthology.parallel:result is None 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe9f8077fc0 msgr2=0x7fe9f807a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe9f8077fc0 0x7fe9f807a480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea10001e10 tx=0x7fea10009040 comp rx=0 tx=0).stop 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 msgr2=0x7fea180b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 0x7fea180b5f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea08009850 tx=0x7fea080038a0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 shutdown_connections 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea18162110 0x7fea180caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe9f8077fc0 0x7fe9f807a480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea18161cb0 0x7fea180b5f80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 --2- 172.21.15.100:0/4192140420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea1815daa0 0x7fea18147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 >> 172.21.15.100:0/4192140420 conn(0x7fea180d3a40 msgr2=0x7fea180b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 shutdown_connections 2024-09-10T21:06:29.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.751+0000 7fea1e400640 1 -- 172.21.15.100:0/4192140420 wait complete. 2024-09-10T21:06:29.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.756+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f947004bd90 con 0x7f947004eb20 2024-09-10T21:06:29.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.757+0000 7f9474c00640 1 -- 172.21.15.100:0/3960079161 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f946c061eb0 con 0x7f947004eb20 2024-09-10T21:06:29.761 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9458077f70 msgr2=0x7f945807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9458077f70 0x7f945807a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94640058c0 tx=0x7f9464005850 comp rx=0 tx=0).stop 2024-09-10T21:06:29.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f947004eb20 msgr2=0x7f94700520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f947004eb20 0x7f94700520a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f946c00c3c0 tx=0x7f946c00c880 comp rx=0 tx=0).stop 2024-09-10T21:06:29.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 shutdown_connections 2024-09-10T21:06:29.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94700e0ac0 0x7f947004bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9458077f70 0x7f945807a430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9470054f10 0x7f94700525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 --2- 172.21.15.100:0/3960079161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f947004eb20 0x7f94700520a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 >> 172.21.15.100:0/3960079161 conn(0x7f947001d770 msgr2=0x7f9470006250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 shutdown_connections 2024-09-10T21:06:29.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.761+0000 7f947e400640 1 -- 172.21.15.100:0/3960079161 wait complete. 2024-09-10T21:06:29.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.764+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fca441442b0 con 0x7fca44147450 2024-09-10T21:06:29.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.764+0000 7fca3b400640 1 -- 172.21.15.100:0/4015853385 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca3c061c70 con 0x7fca44147450 2024-09-10T21:06:29.769 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fca24078040 msgr2=0x7fca2407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fca24078040 0x7fca2407a500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca30007fd0 tx=0x7fca30007900 comp rx=0 tx=0).stop 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 msgr2=0x7fca440b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 0x7fca440b2410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00c7b0 tx=0x7fca3c00cc70 comp rx=0 tx=0).stop 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 shutdown_connections 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca44147450 0x7fca440b2410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fca24078040 0x7fca2407a500 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca30007fd0 tx=0x7fca30007900 comp rx=0 tx=0).stop 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca44147070 0x7fca44145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 --2- 172.21.15.100:0/4015853385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca44070ec0 0x7fca44144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 >> 172.21.15.100:0/4015853385 conn(0x7fca4406dc60 msgr2=0x7fca440cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 shutdown_connections 2024-09-10T21:06:29.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.767+0000 7fca49e00640 1 -- 172.21.15.100:0/4015853385 wait complete. 2024-09-10T21:06:29.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.774+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2ee8052bd0 con 0x7f2ee8037f00 2024-09-10T21:06:29.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.775+0000 7f2ee3e00640 1 -- 172.21.15.100:0/748209647 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2edc049060 con 0x7f2ee8037f00 2024-09-10T21:06:29.780 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-10T21:06:29.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-10T21:06:29.781 DEBUG:teuthology.parallel:result is None 2024-09-10T21:06:29.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.777+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa4300711d0 con 0x7fa43006d260 2024-09-10T21:06:29.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.778+0000 7fa427400640 1 -- 172.21.15.100:0/1267540569 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa420087d50 con 0x7fa43006d260 2024-09-10T21:06:29.782 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-10T21:06:29.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.778+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2ed0078040 msgr2=0x7f2ed007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.778+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2ed0078040 0x7f2ed007a500 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80cea90 tx=0x7f2ee4009260 comp rx=0 tx=0).stop 2024-09-10T21:06:29.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.778+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ee8037f00 msgr2=0x7f2ee804f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.778+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ee8037f00 0x7f2ee804f910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0098b0 tx=0x7f2edc030650 comp rx=0 tx=0).stop 2024-09-10T21:06:29.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.778+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 shutdown_connections 2024-09-10T21:06:29.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.779+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee80e2790 0x7f2ee817cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.779+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ee803b930 0x7f2ee804ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.779+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2ed0078040 0x7f2ed007a500 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.779+0000 7f2ef6c00640 1 --2- 172.21.15.100:0/748209647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ee8037f00 0x7f2ee804f910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.779+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 >> 172.21.15.100:0/748209647 conn(0x7f2ee803a3c0 msgr2=0x7f2ee80374a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.779+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 shutdown_connections 2024-09-10T21:06:29.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.779+0000 7f2ef6c00640 1 -- 172.21.15.100:0/748209647 wait complete. 2024-09-10T21:06:29.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa410078040 msgr2=0x7fa41007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa410078040 0x7fa41007a500 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4301f2290 tx=0x7fa41c009040 comp rx=0 tx=0).stop 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa43006d260 msgr2=0x7fa430157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa43006d260 0x7fa430157050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa420000c00 tx=0x7fa420003b90 comp rx=0 tx=0).stop 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 shutdown_connections 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa430161e50 0x7fa4300ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa410078040 0x7fa41007a500 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4300afd10 0x7fa43014e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 --2- 172.21.15.100:0/1267540569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa43006d260 0x7fa430157050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.782+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 >> 172.21.15.100:0/1267540569 conn(0x7fa43006dc60 msgr2=0x7fa4300ada70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.783+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 shutdown_connections 2024-09-10T21:06:29.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.783+0000 7fa435000640 1 -- 172.21.15.100:0/1267540569 wait complete. 2024-09-10T21:06:29.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.784+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc7040b9bb0 con 0x7fc7040d21f0 2024-09-10T21:06:29.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.785+0000 7fc6faa00640 1 -- 172.21.15.100:0/3817717897 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6ec061ea0 con 0x7fc7040d21f0 2024-09-10T21:06:29.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-10T21:06:29.790 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-10T21:06:29.791 DEBUG:teuthology.parallel:result is None 2024-09-10T21:06:29.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc6e0077fc0 msgr2=0x7fc6e007a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc6e0077fc0 0x7fc6e007a480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400b810 tx=0x7fc6f4008040 comp rx=0 tx=0).stop 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 msgr2=0x7fc704200ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 0x7fc704200ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00c3f0 tx=0x7fc6ec00c8b0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 shutdown_connections 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc6e0077fc0 0x7fc6e007a480 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc70415ddb0 0x7fc7040c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7040d21f0 0x7fc704200ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 --2- 172.21.15.100:0/3817717897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7040d10b0 0x7fc704073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 >> 172.21.15.100:0/3817717897 conn(0x7fc7040d3c30 msgr2=0x7fc704160680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 shutdown_connections 2024-09-10T21:06:29.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:29.788+0000 7fc709800640 1 -- 172.21.15.100:0/3817717897 wait complete. 2024-09-10T21:06:29.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-10T21:06:29.795 DEBUG:teuthology.parallel:result is None 2024-09-10T21:06:29.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-09-10T21:06:29.806 DEBUG:teuthology.parallel:result is None 2024-09-10T21:06:29.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-09-10T21:06:29.807 DEBUG:teuthology.parallel:result is None 2024-09-10T21:06:29.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-10T21:06:29.810 DEBUG:teuthology.parallel:result is None 2024-09-10T21:06:29.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T21:06:29.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:06:30.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.003+0000 7f6cf9400640 1 -- 172.21.15.100:0/1117865256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd8003a70 msgr2=0x7f6cd8003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.003+0000 7f6cf9400640 1 --2- 172.21.15.100:0/1117865256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd8003a70 0x7f6cd8003e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400bb20 tx=0x7f6cd8005830 comp rx=0 tx=0).stop 2024-09-10T21:06:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.003+0000 7f6cf8a00640 1 -- 172.21.15.100:0/1117865256 reap_dead start 2024-09-10T21:06:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.004+0000 7f6cf9400640 1 -- 172.21.15.100:0/1117865256 shutdown_connections 2024-09-10T21:06:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.004+0000 7f6cf9400640 1 -- 172.21.15.100:0/1117865256 >> 172.21.15.100:0/1117865256 conn(0x7f6cf40d3ab0 msgr2=0x7f6cf40d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.004+0000 7f6cf9400640 1 -- 172.21.15.100:0/1117865256 shutdown_connections 2024-09-10T21:06:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.004+0000 7f6cf9400640 1 -- 172.21.15.100:0/1117865256 wait complete. 2024-09-10T21:06:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.005+0000 7f6cf9400640 1 Processor -- start 2024-09-10T21:06:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.005+0000 7f6cf9400640 1 -- start start 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.006+0000 7f6cf9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cd8003a70 0x7f6cf41f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.006+0000 7f6cf9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cf40c75e0 0x7f6cf40c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.006+0000 7f6cf9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf40c94c0 0x7f6cf40c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.006+0000 7f6cf9400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf406e770 con 0x7f6cf40c94c0 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.006+0000 7f6cf9400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf4161730 con 0x7f6cf40c75e0 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.006+0000 7f6cf9400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf406e8f0 con 0x7f6cd8003a70 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.006+0000 7f6cf8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf40c94c0 0x7f6cf40c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf40c94c0 0x7f6cf40c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35230/0 (socket says 172.21.15.100:35230) 2024-09-10T21:06:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf8a00640 1 -- 172.21.15.100:0/3821288239 learned_addr learned my addr 172.21.15.100:0/3821288239 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf3e00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cd8003a70 0x7f6cf41f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cebe00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cf40c75e0 0x7f6cf40c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf8a00640 1 -- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cd8003a70 msgr2=0x7f6cf41f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf8a00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cd8003a70 0x7f6cf41f1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf8a00640 1 -- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cf40c75e0 msgr2=0x7f6cf40c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf8a00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cf40c75e0 0x7f6cf40c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf8a00640 1 -- 172.21.15.100:0/3821288239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf40c9e80 con 0x7f6cf40c94c0 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cebe00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cf40c75e0 0x7f6cf40c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf8a00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf40c94c0 0x7f6cf40c9940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6cf408e2e0 tx=0x7f6cec00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf0c00640 1 -- 172.21.15.100:0/3821288239 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00caf0 con 0x7f6cf40c94c0 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf0c00640 1 -- 172.21.15.100:0/3821288239 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cec017070 con 0x7f6cf40c94c0 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf0c00640 1 -- 172.21.15.100:0/3821288239 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec011460 con 0x7f6cf40c94c0 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.007+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf40c80a0 con 0x7f6cf40c94c0 2024-09-10T21:06:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.008+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf40c8660 con 0x7f6cf40c94c0 2024-09-10T21:06:30.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.009+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf406d7b0 con 0x7f6cf40c94c0 2024-09-10T21:06:30.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.010+0000 7f6cf0c00640 1 -- 172.21.15.100:0/3821288239 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6cec011600 con 0x7f6cf40c94c0 2024-09-10T21:06:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.011+0000 7f6cf0c00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6cd0077f70 0x7f6cd007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.011+0000 7f6cf0c00640 1 -- 172.21.15.100:0/3821288239 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6cec09a520 con 0x7f6cf40c94c0 2024-09-10T21:06:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.011+0000 7f6cf3e00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6cd0077f70 0x7f6cd007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.012+0000 7f6cf3e00640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6cd0077f70 0x7f6cd007a430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4036000 tx=0x7f6ce403c040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.015+0000 7f6cf0c00640 1 -- 172.21.15.100:0/3821288239 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6cec062cd0 con 0x7f6cf40c94c0 2024-09-10T21:06:30.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.194+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6cf40b3570 con 0x7f6cd0077f70 2024-09-10T21:06:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.200+0000 7f6cf0c00640 1 -- 172.21.15.100:0/3821288239 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f6cf40b3570 con 0x7f6cd0077f70 2024-09-10T21:06:30.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:06:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.204+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6cd0077f70 msgr2=0x7f6cd007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.204+0000 7f6cf9400640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6cd0077f70 0x7f6cd007a430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4036000 tx=0x7f6ce403c040 comp rx=0 tx=0).stop 2024-09-10T21:06:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf40c94c0 msgr2=0x7f6cf40c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf40c94c0 0x7f6cf40c9940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6cf408e2e0 tx=0x7f6cec00ed10 comp rx=0 tx=0).stop 2024-09-10T21:06:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 shutdown_connections 2024-09-10T21:06:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf40c94c0 0x7f6cf40c9940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6cd0077f70 0x7f6cd007a430 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cf40c75e0 0x7f6cf40c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 --2- 172.21.15.100:0/3821288239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cd8003a70 0x7f6cf41f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 >> 172.21.15.100:0/3821288239 conn(0x7f6cf40d3ab0 msgr2=0x7f6cf40d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 shutdown_connections 2024-09-10T21:06:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.205+0000 7f6cf9400640 1 -- 172.21.15.100:0/3821288239 wait complete. 2024-09-10T21:06:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-10T21:06:28.692001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003456"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106808+0000","last_change":"2024-09-10T21:06:06.737219+0000","last_active":"2024-09-10T21:06:13.106808+0000","last_peered":"2024-09-10T21:06:13.106808+0000","last_clean":"2024-09-10T21:06:13.106808+0000","last_became_active":"2024-09-10T21:06:06.736940+0000","last_became_peered":"2024-09-10T21:06:06.736940+0000","last_unstale":"2024-09-10T21:06:13.106808+0000","last_undegraded":"2024-09-10T21:06:13.106808+0000","last_fullsized":"2024-09-10T21:06:13.106808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096347+0000","last_change":"2024-09-10T21:06:07.729261+0000","last_active":"2024-09-10T21:06:13.096347+0000","last_peered":"2024-09-10T21:06:13.096347+0000","last_clean":"2024-09-10T21:06:13.096347+0000","last_became_active":"2024-09-10T21:06:07.728483+0000","last_became_peered":"2024-09-10T21:06:07.728483+0000","last_unstale":"2024-09-10T21:06:13.096347+0000","last_undegraded":"2024-09-10T21:06:13.096347+0000","last_fullsized":"2024-09-10T21:06:13.096347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:20.894078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754483+0000","last_change":"2024-09-10T21:06:11.772637+0000","last_active":"2024-09-10T21:06:12.754483+0000","last_peered":"2024-09-10T21:06:12.754483+0000","last_clean":"2024-09-10T21:06:12.754483+0000","last_became_active":"2024-09-10T21:06:11.771448+0000","last_became_peered":"2024-09-10T21:06:11.771448+0000","last_unstale":"2024-09-10T21:06:12.754483+0000","last_undegraded":"2024-09-10T21:06:12.754483+0000","last_fullsized":"2024-09-10T21:06:12.754483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:42.328984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096457+0000","last_change":"2024-09-10T21:06:06.732030+0000","last_active":"2024-09-10T21:06:13.096457+0000","last_peered":"2024-09-10T21:06:13.096457+0000","last_clean":"2024-09-10T21:06:13.096457+0000","last_became_active":"2024-09-10T21:06:06.731060+0000","last_became_peered":"2024-09-10T21:06:06.731060+0000","last_unstale":"2024-09-10T21:06:13.096457+0000","last_undegraded":"2024-09-10T21:06:13.096457+0000","last_fullsized":"2024-09-10T21:06:13.096457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:58.950962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096699+0000","last_change":"2024-09-10T21:06:07.738136+0000","last_active":"2024-09-10T21:06:13.096699+0000","last_peered":"2024-09-10T21:06:13.096699+0000","last_clean":"2024-09-10T21:06:13.096699+0000","last_became_active":"2024-09-10T21:06:07.737068+0000","last_became_peered":"2024-09-10T21:06:07.737068+0000","last_unstale":"2024-09-10T21:06:13.096699+0000","last_undegraded":"2024-09-10T21:06:13.096699+0000","last_fullsized":"2024-09-10T21:06:13.096699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:21.806911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105233+0000","last_change":"2024-09-10T21:06:11.779585+0000","last_active":"2024-09-10T21:06:13.105233+0000","last_peered":"2024-09-10T21:06:13.105233+0000","last_clean":"2024-09-10T21:06:13.105233+0000","last_became_active":"2024-09-10T21:06:11.779111+0000","last_became_peered":"2024-09-10T21:06:11.779111+0000","last_unstale":"2024-09-10T21:06:13.105233+0000","last_undegraded":"2024-09-10T21:06:13.105233+0000","last_fullsized":"2024-09-10T21:06:13.105233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:55.529656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751770+0000","last_change":"2024-09-10T21:06:06.730043+0000","last_active":"2024-09-10T21:06:12.751770+0000","last_peered":"2024-09-10T21:06:12.751770+0000","last_clean":"2024-09-10T21:06:12.751770+0000","last_became_active":"2024-09-10T21:06:06.729736+0000","last_became_peered":"2024-09-10T21:06:06.729736+0000","last_unstale":"2024-09-10T21:06:12.751770+0000","last_undegraded":"2024-09-10T21:06:12.751770+0000","last_fullsized":"2024-09-10T21:06:12.751770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:03.085613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754713+0000","last_change":"2024-09-10T21:06:07.749059+0000","last_active":"2024-09-10T21:06:12.754713+0000","last_peered":"2024-09-10T21:06:12.754713+0000","last_clean":"2024-09-10T21:06:12.754713+0000","last_became_active":"2024-09-10T21:06:07.748645+0000","last_became_peered":"2024-09-10T21:06:07.748645+0000","last_unstale":"2024-09-10T21:06:12.754713+0000","last_undegraded":"2024-09-10T21:06:12.754713+0000","last_fullsized":"2024-09-10T21:06:12.754713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:43.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106613+0000","last_change":"2024-09-10T21:06:11.774923+0000","last_active":"2024-09-10T21:06:13.106613+0000","last_peered":"2024-09-10T21:06:13.106613+0000","last_clean":"2024-09-10T21:06:13.106613+0000","last_became_active":"2024-09-10T21:06:11.774581+0000","last_became_peered":"2024-09-10T21:06:11.774581+0000","last_unstale":"2024-09-10T21:06:13.106613+0000","last_undegraded":"2024-09-10T21:06:13.106613+0000","last_fullsized":"2024-09-10T21:06:13.106613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:43.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751739+0000","last_change":"2024-09-10T21:06:06.725866+0000","last_active":"2024-09-10T21:06:12.751739+0000","last_peered":"2024-09-10T21:06:12.751739+0000","last_clean":"2024-09-10T21:06:12.751739+0000","last_became_active":"2024-09-10T21:06:06.725590+0000","last_became_peered":"2024-09-10T21:06:06.725590+0000","last_unstale":"2024-09-10T21:06:12.751739+0000","last_undegraded":"2024-09-10T21:06:12.751739+0000","last_fullsized":"2024-09-10T21:06:12.751739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106462+0000","last_change":"2024-09-10T21:06:07.748653+0000","last_active":"2024-09-10T21:06:13.106462+0000","last_peered":"2024-09-10T21:06:13.106462+0000","last_clean":"2024-09-10T21:06:13.106462+0000","last_became_active":"2024-09-10T21:06:07.748366+0000","last_became_peered":"2024-09-10T21:06:07.748366+0000","last_unstale":"2024-09-10T21:06:13.106462+0000","last_undegraded":"2024-09-10T21:06:13.106462+0000","last_fullsized":"2024-09-10T21:06:13.106462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:19.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105881+0000","last_change":"2024-09-10T21:06:11.768824+0000","last_active":"2024-09-10T21:06:13.105881+0000","last_peered":"2024-09-10T21:06:13.105881+0000","last_clean":"2024-09-10T21:06:13.105881+0000","last_became_active":"2024-09-10T21:06:11.768442+0000","last_became_peered":"2024-09-10T21:06:11.768442+0000","last_unstale":"2024-09-10T21:06:13.105881+0000","last_undegraded":"2024-09-10T21:06:13.105881+0000","last_fullsized":"2024-09-10T21:06:13.105881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:05.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105671+0000","last_change":"2024-09-10T21:06:07.733906+0000","last_active":"2024-09-10T21:06:13.105671+0000","last_peered":"2024-09-10T21:06:13.105671+0000","last_clean":"2024-09-10T21:06:13.105671+0000","last_became_active":"2024-09-10T21:06:07.733681+0000","last_became_peered":"2024-09-10T21:06:07.733681+0000","last_unstale":"2024-09-10T21:06:13.105671+0000","last_undegraded":"2024-09-10T21:06:13.105671+0000","last_fullsized":"2024-09-10T21:06:13.105671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:17.153627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106032+0000","last_change":"2024-09-10T21:06:06.732743+0000","last_active":"2024-09-10T21:06:13.106032+0000","last_peered":"2024-09-10T21:06:13.106032+0000","last_clean":"2024-09-10T21:06:13.106032+0000","last_became_active":"2024-09-10T21:06:06.732494+0000","last_became_peered":"2024-09-10T21:06:06.732494+0000","last_unstale":"2024-09-10T21:06:13.106032+0000","last_undegraded":"2024-09-10T21:06:13.106032+0000","last_fullsized":"2024-09-10T21:06:13.106032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:03.085613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107067+0000","last_change":"2024-09-10T21:06:11.777327+0000","last_active":"2024-09-10T21:06:13.107067+0000","last_peered":"2024-09-10T21:06:13.107067+0000","last_clean":"2024-09-10T21:06:13.107067+0000","last_became_active":"2024-09-10T21:06:11.771004+0000","last_became_peered":"2024-09-10T21:06:11.771004+0000","last_unstale":"2024-09-10T21:06:13.107067+0000","last_undegraded":"2024-09-10T21:06:13.107067+0000","last_fullsized":"2024-09-10T21:06:13.107067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:35.265715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755166+0000","last_change":"2024-09-10T21:06:07.734707+0000","last_active":"2024-09-10T21:06:12.755166+0000","last_peered":"2024-09-10T21:06:12.755166+0000","last_clean":"2024-09-10T21:06:12.755166+0000","last_became_active":"2024-09-10T21:06:07.733049+0000","last_became_peered":"2024-09-10T21:06:07.733049+0000","last_unstale":"2024-09-10T21:06:12.755166+0000","last_undegraded":"2024-09-10T21:06:12.755166+0000","last_fullsized":"2024-09-10T21:06:12.755166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106234+0000","last_change":"2024-09-10T21:06:06.720924+0000","last_active":"2024-09-10T21:06:13.106234+0000","last_peered":"2024-09-10T21:06:13.106234+0000","last_clean":"2024-09-10T21:06:13.106234+0000","last_became_active":"2024-09-10T21:06:06.719357+0000","last_became_peered":"2024-09-10T21:06:06.719357+0000","last_unstale":"2024-09-10T21:06:13.106234+0000","last_undegraded":"2024-09-10T21:06:13.106234+0000","last_fullsized":"2024-09-10T21:06:13.106234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:17.674783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751373+0000","last_change":"2024-09-10T21:06:11.771235+0000","last_active":"2024-09-10T21:06:12.751373+0000","last_peered":"2024-09-10T21:06:12.751373+0000","last_clean":"2024-09-10T21:06:12.751373+0000","last_became_active":"2024-09-10T21:06:11.770880+0000","last_became_peered":"2024-09-10T21:06:11.770880+0000","last_unstale":"2024-09-10T21:06:12.751373+0000","last_undegraded":"2024-09-10T21:06:12.751373+0000","last_fullsized":"2024-09-10T21:06:12.751373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:41.810392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105840+0000","last_change":"2024-09-10T21:06:07.736240+0000","last_active":"2024-09-10T21:06:13.105840+0000","last_peered":"2024-09-10T21:06:13.105840+0000","last_clean":"2024-09-10T21:06:13.105840+0000","last_became_active":"2024-09-10T21:06:07.735925+0000","last_became_peered":"2024-09-10T21:06:07.735925+0000","last_unstale":"2024-09-10T21:06:13.105840+0000","last_undegraded":"2024-09-10T21:06:13.105840+0000","last_fullsized":"2024-09-10T21:06:13.105840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:38.292268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106193+0000","last_change":"2024-09-10T21:06:06.736359+0000","last_active":"2024-09-10T21:06:13.106193+0000","last_peered":"2024-09-10T21:06:13.106193+0000","last_clean":"2024-09-10T21:06:13.106193+0000","last_became_active":"2024-09-10T21:06:06.736050+0000","last_became_peered":"2024-09-10T21:06:06.736050+0000","last_unstale":"2024-09-10T21:06:13.106193+0000","last_undegraded":"2024-09-10T21:06:13.106193+0000","last_fullsized":"2024-09-10T21:06:13.106193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:23.541255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755047+0000","last_change":"2024-09-10T21:06:11.777086+0000","last_active":"2024-09-10T21:06:12.755047+0000","last_peered":"2024-09-10T21:06:12.755047+0000","last_clean":"2024-09-10T21:06:12.755047+0000","last_became_active":"2024-09-10T21:06:11.775942+0000","last_became_peered":"2024-09-10T21:06:11.775942+0000","last_unstale":"2024-09-10T21:06:12.755047+0000","last_undegraded":"2024-09-10T21:06:12.755047+0000","last_fullsized":"2024-09-10T21:06:12.755047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:32.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105699+0000","last_change":"2024-09-10T21:06:07.733238+0000","last_active":"2024-09-10T21:06:13.105699+0000","last_peered":"2024-09-10T21:06:13.105699+0000","last_clean":"2024-09-10T21:06:13.105699+0000","last_became_active":"2024-09-10T21:06:07.732976+0000","last_became_peered":"2024-09-10T21:06:07.732976+0000","last_unstale":"2024-09-10T21:06:13.105699+0000","last_undegraded":"2024-09-10T21:06:13.105699+0000","last_fullsized":"2024-09-10T21:06:13.105699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.194600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.750898+0000","last_change":"2024-09-10T21:06:06.729612+0000","last_active":"2024-09-10T21:06:12.750898+0000","last_peered":"2024-09-10T21:06:12.750898+0000","last_clean":"2024-09-10T21:06:12.750898+0000","last_became_active":"2024-09-10T21:06:06.729273+0000","last_became_peered":"2024-09-10T21:06:06.729273+0000","last_unstale":"2024-09-10T21:06:12.750898+0000","last_undegraded":"2024-09-10T21:06:12.750898+0000","last_fullsized":"2024-09-10T21:06:12.750898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:31.995655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107550+0000","last_change":"2024-09-10T21:06:11.775010+0000","last_active":"2024-09-10T21:06:13.107550+0000","last_peered":"2024-09-10T21:06:13.107550+0000","last_clean":"2024-09-10T21:06:13.107550+0000","last_became_active":"2024-09-10T21:06:11.774620+0000","last_became_peered":"2024-09-10T21:06:11.774620+0000","last_unstale":"2024-09-10T21:06:13.107550+0000","last_undegraded":"2024-09-10T21:06:13.107550+0000","last_fullsized":"2024-09-10T21:06:13.107550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:16.623420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106018+0000","last_change":"2024-09-10T21:06:07.738509+0000","last_active":"2024-09-10T21:06:13.106018+0000","last_peered":"2024-09-10T21:06:13.106018+0000","last_clean":"2024-09-10T21:06:13.106018+0000","last_became_active":"2024-09-10T21:06:07.738191+0000","last_became_peered":"2024-09-10T21:06:07.738191+0000","last_unstale":"2024-09-10T21:06:13.106018+0000","last_undegraded":"2024-09-10T21:06:13.106018+0000","last_fullsized":"2024-09-10T21:06:13.106018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:55.563240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107096+0000","last_change":"2024-09-10T21:06:06.729882+0000","last_active":"2024-09-10T21:06:13.107096+0000","last_peered":"2024-09-10T21:06:13.107096+0000","last_clean":"2024-09-10T21:06:13.107096+0000","last_became_active":"2024-09-10T21:06:06.729598+0000","last_became_peered":"2024-09-10T21:06:06.729598+0000","last_unstale":"2024-09-10T21:06:13.107096+0000","last_undegraded":"2024-09-10T21:06:13.107096+0000","last_fullsized":"2024-09-10T21:06:13.107096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105187+0000","last_change":"2024-09-10T21:06:11.773911+0000","last_active":"2024-09-10T21:06:13.105187+0000","last_peered":"2024-09-10T21:06:13.105187+0000","last_clean":"2024-09-10T21:06:13.105187+0000","last_became_active":"2024-09-10T21:06:11.773571+0000","last_became_peered":"2024-09-10T21:06:11.773571+0000","last_unstale":"2024-09-10T21:06:13.105187+0000","last_undegraded":"2024-09-10T21:06:13.105187+0000","last_fullsized":"2024-09-10T21:06:13.105187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:59.082471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106726+0000","last_change":"2024-09-10T21:06:07.744529+0000","last_active":"2024-09-10T21:06:13.106726+0000","last_peered":"2024-09-10T21:06:13.106726+0000","last_clean":"2024-09-10T21:06:13.106726+0000","last_became_active":"2024-09-10T21:06:07.744283+0000","last_became_peered":"2024-09-10T21:06:07.744283+0000","last_unstale":"2024-09-10T21:06:13.106726+0000","last_undegraded":"2024-09-10T21:06:13.106726+0000","last_fullsized":"2024-09-10T21:06:13.106726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:22.708264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106805+0000","last_change":"2024-09-10T21:06:06.735762+0000","last_active":"2024-09-10T21:06:13.106805+0000","last_peered":"2024-09-10T21:06:13.106805+0000","last_clean":"2024-09-10T21:06:13.106805+0000","last_became_active":"2024-09-10T21:06:06.735504+0000","last_became_peered":"2024-09-10T21:06:06.735504+0000","last_unstale":"2024-09-10T21:06:13.106805+0000","last_undegraded":"2024-09-10T21:06:13.106805+0000","last_fullsized":"2024-09-10T21:06:13.106805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:30.893513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105651+0000","last_change":"2024-09-10T21:06:11.759166+0000","last_active":"2024-09-10T21:06:13.105651+0000","last_peered":"2024-09-10T21:06:13.105651+0000","last_clean":"2024-09-10T21:06:13.105651+0000","last_became_active":"2024-09-10T21:06:11.758731+0000","last_became_peered":"2024-09-10T21:06:11.758731+0000","last_unstale":"2024-09-10T21:06:13.105651+0000","last_undegraded":"2024-09-10T21:06:13.105651+0000","last_fullsized":"2024-09-10T21:06:13.105651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:35.741616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106957+0000","last_change":"2024-09-10T21:06:07.730449+0000","last_active":"2024-09-10T21:06:13.106957+0000","last_peered":"2024-09-10T21:06:13.106957+0000","last_clean":"2024-09-10T21:06:13.106957+0000","last_became_active":"2024-09-10T21:06:07.730138+0000","last_became_peered":"2024-09-10T21:06:07.730138+0000","last_unstale":"2024-09-10T21:06:13.106957+0000","last_undegraded":"2024-09-10T21:06:13.106957+0000","last_fullsized":"2024-09-10T21:06:13.106957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:52.489450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106921+0000","last_change":"2024-09-10T21:06:06.733157+0000","last_active":"2024-09-10T21:06:13.106921+0000","last_peered":"2024-09-10T21:06:13.106921+0000","last_clean":"2024-09-10T21:06:13.106921+0000","last_became_active":"2024-09-10T21:06:06.731969+0000","last_became_peered":"2024-09-10T21:06:06.731969+0000","last_unstale":"2024-09-10T21:06:13.106921+0000","last_undegraded":"2024-09-10T21:06:13.106921+0000","last_fullsized":"2024-09-10T21:06:13.106921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:29.608127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106173+0000","last_change":"2024-09-10T21:06:11.765210+0000","last_active":"2024-09-10T21:06:13.106173+0000","last_peered":"2024-09-10T21:06:13.106173+0000","last_clean":"2024-09-10T21:06:13.106173+0000","last_became_active":"2024-09-10T21:06:11.764692+0000","last_became_peered":"2024-09-10T21:06:11.764692+0000","last_unstale":"2024-09-10T21:06:13.106173+0000","last_undegraded":"2024-09-10T21:06:13.106173+0000","last_fullsized":"2024-09-10T21:06:13.106173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:43.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107298+0000","last_change":"2024-09-10T21:06:07.740729+0000","last_active":"2024-09-10T21:06:13.107298+0000","last_peered":"2024-09-10T21:06:13.107298+0000","last_clean":"2024-09-10T21:06:13.107298+0000","last_became_active":"2024-09-10T21:06:07.740268+0000","last_became_peered":"2024-09-10T21:06:07.740268+0000","last_unstale":"2024-09-10T21:06:13.107298+0000","last_undegraded":"2024-09-10T21:06:13.107298+0000","last_fullsized":"2024-09-10T21:06:13.107298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095917+0000","last_change":"2024-09-10T21:06:06.727108+0000","last_active":"2024-09-10T21:06:13.095917+0000","last_peered":"2024-09-10T21:06:13.095917+0000","last_clean":"2024-09-10T21:06:13.095917+0000","last_became_active":"2024-09-10T21:06:06.724197+0000","last_became_peered":"2024-09-10T21:06:06.724197+0000","last_unstale":"2024-09-10T21:06:13.095917+0000","last_undegraded":"2024-09-10T21:06:13.095917+0000","last_fullsized":"2024-09-10T21:06:13.095917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:42.221414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105780+0000","last_change":"2024-09-10T21:06:11.761088+0000","last_active":"2024-09-10T21:06:13.105780+0000","last_peered":"2024-09-10T21:06:13.105780+0000","last_clean":"2024-09-10T21:06:13.105780+0000","last_became_active":"2024-09-10T21:06:11.760606+0000","last_became_peered":"2024-09-10T21:06:11.760606+0000","last_unstale":"2024-09-10T21:06:13.105780+0000","last_undegraded":"2024-09-10T21:06:13.105780+0000","last_fullsized":"2024-09-10T21:06:13.105780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:55.529656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751220+0000","last_change":"2024-09-10T21:06:07.740212+0000","last_active":"2024-09-10T21:06:12.751220+0000","last_peered":"2024-09-10T21:06:12.751220+0000","last_clean":"2024-09-10T21:06:12.751220+0000","last_became_active":"2024-09-10T21:06:07.739862+0000","last_became_peered":"2024-09-10T21:06:07.739862+0000","last_unstale":"2024-09-10T21:06:12.751220+0000","last_undegraded":"2024-09-10T21:06:12.751220+0000","last_fullsized":"2024-09-10T21:06:12.751220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:59.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105875+0000","last_change":"2024-09-10T21:06:06.720349+0000","last_active":"2024-09-10T21:06:13.105875+0000","last_peered":"2024-09-10T21:06:13.105875+0000","last_clean":"2024-09-10T21:06:13.105875+0000","last_became_active":"2024-09-10T21:06:06.719193+0000","last_became_peered":"2024-09-10T21:06:06.719193+0000","last_unstale":"2024-09-10T21:06:13.105875+0000","last_undegraded":"2024-09-10T21:06:13.105875+0000","last_fullsized":"2024-09-10T21:06:13.105875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:14.047312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106576+0000","last_change":"2024-09-10T21:06:11.764876+0000","last_active":"2024-09-10T21:06:13.106576+0000","last_peered":"2024-09-10T21:06:13.106576+0000","last_clean":"2024-09-10T21:06:13.106576+0000","last_became_active":"2024-09-10T21:06:11.762830+0000","last_became_peered":"2024-09-10T21:06:11.762830+0000","last_unstale":"2024-09-10T21:06:13.106576+0000","last_undegraded":"2024-09-10T21:06:13.106576+0000","last_fullsized":"2024-09-10T21:06:13.106576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.820369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095486+0000","last_change":"2024-09-10T21:06:07.728902+0000","last_active":"2024-09-10T21:06:13.095486+0000","last_peered":"2024-09-10T21:06:13.095486+0000","last_clean":"2024-09-10T21:06:13.095486+0000","last_became_active":"2024-09-10T21:06:07.727554+0000","last_became_peered":"2024-09-10T21:06:07.727554+0000","last_unstale":"2024-09-10T21:06:13.095486+0000","last_undegraded":"2024-09-10T21:06:13.095486+0000","last_fullsized":"2024-09-10T21:06:13.095486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:30.750244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754573+0000","last_change":"2024-09-10T21:06:06.738792+0000","last_active":"2024-09-10T21:06:12.754573+0000","last_peered":"2024-09-10T21:06:12.754573+0000","last_clean":"2024-09-10T21:06:12.754573+0000","last_became_active":"2024-09-10T21:06:06.735261+0000","last_became_peered":"2024-09-10T21:06:06.735261+0000","last_unstale":"2024-09-10T21:06:12.754573+0000","last_undegraded":"2024-09-10T21:06:12.754573+0000","last_fullsized":"2024-09-10T21:06:12.754573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:04.060073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107278+0000","last_change":"2024-09-10T21:06:11.759571+0000","last_active":"2024-09-10T21:06:13.107278+0000","last_peered":"2024-09-10T21:06:13.107278+0000","last_clean":"2024-09-10T21:06:13.107278+0000","last_became_active":"2024-09-10T21:06:11.758333+0000","last_became_peered":"2024-09-10T21:06:11.758333+0000","last_unstale":"2024-09-10T21:06:13.107278+0000","last_undegraded":"2024-09-10T21:06:13.107278+0000","last_fullsized":"2024-09-10T21:06:13.107278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:19.666141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105462+0000","last_change":"2024-09-10T21:06:07.730355+0000","last_active":"2024-09-10T21:06:13.105462+0000","last_peered":"2024-09-10T21:06:13.105462+0000","last_clean":"2024-09-10T21:06:13.105462+0000","last_became_active":"2024-09-10T21:06:07.728407+0000","last_became_peered":"2024-09-10T21:06:07.728407+0000","last_unstale":"2024-09-10T21:06:13.105462+0000","last_undegraded":"2024-09-10T21:06:13.105462+0000","last_fullsized":"2024-09-10T21:06:13.105462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105889+0000","last_change":"2024-09-10T21:06:06.724834+0000","last_active":"2024-09-10T21:06:13.105889+0000","last_peered":"2024-09-10T21:06:13.105889+0000","last_clean":"2024-09-10T21:06:13.105889+0000","last_became_active":"2024-09-10T21:06:06.723605+0000","last_became_peered":"2024-09-10T21:06:06.723605+0000","last_unstale":"2024-09-10T21:06:13.105889+0000","last_undegraded":"2024-09-10T21:06:13.105889+0000","last_fullsized":"2024-09-10T21:06:13.105889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:49.300851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096160+0000","last_change":"2024-09-10T21:06:11.775310+0000","last_active":"2024-09-10T21:06:13.096160+0000","last_peered":"2024-09-10T21:06:13.096160+0000","last_clean":"2024-09-10T21:06:13.096160+0000","last_became_active":"2024-09-10T21:06:11.774927+0000","last_became_peered":"2024-09-10T21:06:11.774927+0000","last_unstale":"2024-09-10T21:06:13.096160+0000","last_undegraded":"2024-09-10T21:06:13.096160+0000","last_fullsized":"2024-09-10T21:06:13.096160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:57.504941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105855+0000","last_change":"2024-09-10T21:06:07.744943+0000","last_active":"2024-09-10T21:06:13.105855+0000","last_peered":"2024-09-10T21:06:13.105855+0000","last_clean":"2024-09-10T21:06:13.105855+0000","last_became_active":"2024-09-10T21:06:07.744127+0000","last_became_peered":"2024-09-10T21:06:07.744127+0000","last_unstale":"2024-09-10T21:06:13.105855+0000","last_undegraded":"2024-09-10T21:06:13.105855+0000","last_fullsized":"2024-09-10T21:06:13.105855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:56.096951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106075+0000","last_change":"2024-09-10T21:06:06.732794+0000","last_active":"2024-09-10T21:06:13.106075+0000","last_peered":"2024-09-10T21:06:13.106075+0000","last_clean":"2024-09-10T21:06:13.106075+0000","last_became_active":"2024-09-10T21:06:06.732524+0000","last_became_peered":"2024-09-10T21:06:06.732524+0000","last_unstale":"2024-09-10T21:06:13.106075+0000","last_undegraded":"2024-09-10T21:06:13.106075+0000","last_fullsized":"2024-09-10T21:06:13.106075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:52.521141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754500+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:06:12.754500+0000","last_peered":"2024-09-10T21:06:12.754500+0000","last_clean":"2024-09-10T21:06:12.754500+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:06:12.754500+0000","last_undegraded":"2024-09-10T21:06:12.754500+0000","last_fullsized":"2024-09-10T21:06:12.754500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106695+0000","last_change":"2024-09-10T21:06:11.771513+0000","last_active":"2024-09-10T21:06:13.106695+0000","last_peered":"2024-09-10T21:06:13.106695+0000","last_clean":"2024-09-10T21:06:13.106695+0000","last_became_active":"2024-09-10T21:06:11.771109+0000","last_became_peered":"2024-09-10T21:06:11.771109+0000","last_unstale":"2024-09-10T21:06:13.106695+0000","last_undegraded":"2024-09-10T21:06:13.106695+0000","last_fullsized":"2024-09-10T21:06:13.106695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:52.565604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106557+0000","last_change":"2024-09-10T21:06:07.735827+0000","last_active":"2024-09-10T21:06:13.106557+0000","last_peered":"2024-09-10T21:06:13.106557+0000","last_clean":"2024-09-10T21:06:13.106557+0000","last_became_active":"2024-09-10T21:06:07.735570+0000","last_became_peered":"2024-09-10T21:06:07.735570+0000","last_unstale":"2024-09-10T21:06:13.106557+0000","last_undegraded":"2024-09-10T21:06:13.106557+0000","last_fullsized":"2024-09-10T21:06:13.106557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:26.644366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107030+0000","last_change":"2024-09-10T21:06:06.736508+0000","last_active":"2024-09-10T21:06:13.107030+0000","last_peered":"2024-09-10T21:06:13.107030+0000","last_clean":"2024-09-10T21:06:13.107030+0000","last_became_active":"2024-09-10T21:06:06.733786+0000","last_became_peered":"2024-09-10T21:06:06.733786+0000","last_unstale":"2024-09-10T21:06:13.107030+0000","last_undegraded":"2024-09-10T21:06:13.107030+0000","last_fullsized":"2024-09-10T21:06:13.107030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:20.425789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106109+0000","last_change":"2024-09-10T21:06:11.773388+0000","last_active":"2024-09-10T21:06:13.106109+0000","last_peered":"2024-09-10T21:06:13.106109+0000","last_clean":"2024-09-10T21:06:13.106109+0000","last_became_active":"2024-09-10T21:06:11.773037+0000","last_became_peered":"2024-09-10T21:06:11.773037+0000","last_unstale":"2024-09-10T21:06:13.106109+0000","last_undegraded":"2024-09-10T21:06:13.106109+0000","last_fullsized":"2024-09-10T21:06:13.106109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:19.666141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751686+0000","last_change":"2024-09-10T21:06:07.741169+0000","last_active":"2024-09-10T21:06:12.751686+0000","last_peered":"2024-09-10T21:06:12.751686+0000","last_clean":"2024-09-10T21:06:12.751686+0000","last_became_active":"2024-09-10T21:06:07.732016+0000","last_became_peered":"2024-09-10T21:06:07.732016+0000","last_unstale":"2024-09-10T21:06:12.751686+0000","last_undegraded":"2024-09-10T21:06:12.751686+0000","last_fullsized":"2024-09-10T21:06:12.751686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:31.704899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096056+0000","last_change":"2024-09-10T21:06:06.723528+0000","last_active":"2024-09-10T21:06:13.096056+0000","last_peered":"2024-09-10T21:06:13.096056+0000","last_clean":"2024-09-10T21:06:13.096056+0000","last_became_active":"2024-09-10T21:06:06.723230+0000","last_became_peered":"2024-09-10T21:06:06.723230+0000","last_unstale":"2024-09-10T21:06:13.096056+0000","last_undegraded":"2024-09-10T21:06:13.096056+0000","last_fullsized":"2024-09-10T21:06:13.096056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:38.577023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095831+0000","last_change":"2024-09-10T21:06:11.764290+0000","last_active":"2024-09-10T21:06:13.095831+0000","last_peered":"2024-09-10T21:06:13.095831+0000","last_clean":"2024-09-10T21:06:13.095831+0000","last_became_active":"2024-09-10T21:06:11.763048+0000","last_became_peered":"2024-09-10T21:06:11.763048+0000","last_unstale":"2024-09-10T21:06:13.095831+0000","last_undegraded":"2024-09-10T21:06:13.095831+0000","last_fullsized":"2024-09-10T21:06:13.095831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:16.973732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751824+0000","last_change":"2024-09-10T21:06:07.747804+0000","last_active":"2024-09-10T21:06:12.751824+0000","last_peered":"2024-09-10T21:06:12.751824+0000","last_clean":"2024-09-10T21:06:12.751824+0000","last_became_active":"2024-09-10T21:06:07.747314+0000","last_became_peered":"2024-09-10T21:06:07.747314+0000","last_unstale":"2024-09-10T21:06:12.751824+0000","last_undegraded":"2024-09-10T21:06:12.751824+0000","last_fullsized":"2024-09-10T21:06:12.751824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:12.784568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106675+0000","last_change":"2024-09-10T21:06:06.733973+0000","last_active":"2024-09-10T21:06:13.106675+0000","last_peered":"2024-09-10T21:06:13.106675+0000","last_clean":"2024-09-10T21:06:13.106675+0000","last_became_active":"2024-09-10T21:06:06.733657+0000","last_became_peered":"2024-09-10T21:06:06.733657+0000","last_unstale":"2024-09-10T21:06:13.106675+0000","last_undegraded":"2024-09-10T21:06:13.106675+0000","last_fullsized":"2024-09-10T21:06:13.106675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.848743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105337+0000","last_change":"2024-09-10T21:06:11.772129+0000","last_active":"2024-09-10T21:06:13.105337+0000","last_peered":"2024-09-10T21:06:13.105337+0000","last_clean":"2024-09-10T21:06:13.105337+0000","last_became_active":"2024-09-10T21:06:11.771760+0000","last_became_peered":"2024-09-10T21:06:11.771760+0000","last_unstale":"2024-09-10T21:06:13.105337+0000","last_undegraded":"2024-09-10T21:06:13.105337+0000","last_fullsized":"2024-09-10T21:06:13.105337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:19.126960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107660+0000","last_change":"2024-09-10T21:06:07.740671+0000","last_active":"2024-09-10T21:06:13.107660+0000","last_peered":"2024-09-10T21:06:13.107660+0000","last_clean":"2024-09-10T21:06:13.107660+0000","last_became_active":"2024-09-10T21:06:07.740358+0000","last_became_peered":"2024-09-10T21:06:07.740358+0000","last_unstale":"2024-09-10T21:06:13.107660+0000","last_undegraded":"2024-09-10T21:06:13.107660+0000","last_fullsized":"2024-09-10T21:06:13.107660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:23.671822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751972+0000","last_change":"2024-09-10T21:06:06.733420+0000","last_active":"2024-09-10T21:06:12.751972+0000","last_peered":"2024-09-10T21:06:12.751972+0000","last_clean":"2024-09-10T21:06:12.751972+0000","last_became_active":"2024-09-10T21:06:06.733124+0000","last_became_peered":"2024-09-10T21:06:06.733124+0000","last_unstale":"2024-09-10T21:06:12.751972+0000","last_undegraded":"2024-09-10T21:06:12.751972+0000","last_fullsized":"2024-09-10T21:06:12.751972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.848743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754527+0000","last_change":"2024-09-10T21:06:11.765124+0000","last_active":"2024-09-10T21:06:12.754527+0000","last_peered":"2024-09-10T21:06:12.754527+0000","last_clean":"2024-09-10T21:06:12.754527+0000","last_became_active":"2024-09-10T21:06:11.764737+0000","last_became_peered":"2024-09-10T21:06:11.764737+0000","last_unstale":"2024-09-10T21:06:12.754527+0000","last_undegraded":"2024-09-10T21:06:12.754527+0000","last_fullsized":"2024-09-10T21:06:12.754527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:54.343216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105542+0000","last_change":"2024-09-10T21:06:07.722858+0000","last_active":"2024-09-10T21:06:13.105542+0000","last_peered":"2024-09-10T21:06:13.105542+0000","last_clean":"2024-09-10T21:06:13.105542+0000","last_became_active":"2024-09-10T21:06:07.722606+0000","last_became_peered":"2024-09-10T21:06:07.722606+0000","last_unstale":"2024-09-10T21:06:13.105542+0000","last_undegraded":"2024-09-10T21:06:13.105542+0000","last_fullsized":"2024-09-10T21:06:13.105542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:12.784568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105962+0000","last_change":"2024-09-10T21:06:06.732829+0000","last_active":"2024-09-10T21:06:13.105962+0000","last_peered":"2024-09-10T21:06:13.105962+0000","last_clean":"2024-09-10T21:06:13.105962+0000","last_became_active":"2024-09-10T21:06:06.732330+0000","last_became_peered":"2024-09-10T21:06:06.732330+0000","last_unstale":"2024-09-10T21:06:13.105962+0000","last_undegraded":"2024-09-10T21:06:13.105962+0000","last_fullsized":"2024-09-10T21:06:13.105962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:31.995655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096366+0000","last_change":"2024-09-10T21:06:11.770617+0000","last_active":"2024-09-10T21:06:13.096366+0000","last_peered":"2024-09-10T21:06:13.096366+0000","last_clean":"2024-09-10T21:06:13.096366+0000","last_became_active":"2024-09-10T21:06:11.770181+0000","last_became_peered":"2024-09-10T21:06:11.770181+0000","last_unstale":"2024-09-10T21:06:13.096366+0000","last_undegraded":"2024-09-10T21:06:13.096366+0000","last_fullsized":"2024-09-10T21:06:13.096366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:24.035068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754317+0000","last_change":"2024-09-10T21:06:07.736943+0000","last_active":"2024-09-10T21:06:12.754317+0000","last_peered":"2024-09-10T21:06:12.754317+0000","last_clean":"2024-09-10T21:06:12.754317+0000","last_became_active":"2024-09-10T21:06:07.734718+0000","last_became_peered":"2024-09-10T21:06:07.734718+0000","last_unstale":"2024-09-10T21:06:12.754317+0000","last_undegraded":"2024-09-10T21:06:12.754317+0000","last_fullsized":"2024-09-10T21:06:12.754317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751075+0000","last_change":"2024-09-10T21:06:06.721908+0000","last_active":"2024-09-10T21:06:12.751075+0000","last_peered":"2024-09-10T21:06:12.751075+0000","last_clean":"2024-09-10T21:06:12.751075+0000","last_became_active":"2024-09-10T21:06:06.721632+0000","last_became_peered":"2024-09-10T21:06:06.721632+0000","last_unstale":"2024-09-10T21:06:12.751075+0000","last_undegraded":"2024-09-10T21:06:12.751075+0000","last_fullsized":"2024-09-10T21:06:12.751075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:23.541255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096704+0000","last_change":"2024-09-10T21:06:11.778809+0000","last_active":"2024-09-10T21:06:13.096704+0000","last_peered":"2024-09-10T21:06:13.096704+0000","last_clean":"2024-09-10T21:06:13.096704+0000","last_became_active":"2024-09-10T21:06:11.773850+0000","last_became_peered":"2024-09-10T21:06:11.773850+0000","last_unstale":"2024-09-10T21:06:13.096704+0000","last_undegraded":"2024-09-10T21:06:13.096704+0000","last_fullsized":"2024-09-10T21:06:13.096704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:31.261505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105504+0000","last_change":"2024-09-10T21:06:07.748130+0000","last_active":"2024-09-10T21:06:13.105504+0000","last_peered":"2024-09-10T21:06:13.105504+0000","last_clean":"2024-09-10T21:06:13.105504+0000","last_became_active":"2024-09-10T21:06:07.747878+0000","last_became_peered":"2024-09-10T21:06:07.747878+0000","last_unstale":"2024-09-10T21:06:13.105504+0000","last_undegraded":"2024-09-10T21:06:13.105504+0000","last_fullsized":"2024-09-10T21:06:13.105504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:59.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105808+0000","last_change":"2024-09-10T21:06:06.726018+0000","last_active":"2024-09-10T21:06:13.105808+0000","last_peered":"2024-09-10T21:06:13.105808+0000","last_clean":"2024-09-10T21:06:13.105808+0000","last_became_active":"2024-09-10T21:06:06.725738+0000","last_became_peered":"2024-09-10T21:06:06.725738+0000","last_unstale":"2024-09-10T21:06:13.105808+0000","last_undegraded":"2024-09-10T21:06:13.105808+0000","last_fullsized":"2024-09-10T21:06:13.105808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:56.619842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105827+0000","last_change":"2024-09-10T21:06:11.765453+0000","last_active":"2024-09-10T21:06:13.105827+0000","last_peered":"2024-09-10T21:06:13.105827+0000","last_clean":"2024-09-10T21:06:13.105827+0000","last_became_active":"2024-09-10T21:06:11.764276+0000","last_became_peered":"2024-09-10T21:06:11.764276+0000","last_unstale":"2024-09-10T21:06:13.105827+0000","last_undegraded":"2024-09-10T21:06:13.105827+0000","last_fullsized":"2024-09-10T21:06:13.105827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:05.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106078+0000","last_change":"2024-09-10T21:06:07.735444+0000","last_active":"2024-09-10T21:06:13.106078+0000","last_peered":"2024-09-10T21:06:13.106078+0000","last_clean":"2024-09-10T21:06:13.106078+0000","last_became_active":"2024-09-10T21:06:07.734064+0000","last_became_peered":"2024-09-10T21:06:07.734064+0000","last_unstale":"2024-09-10T21:06:13.106078+0000","last_undegraded":"2024-09-10T21:06:13.106078+0000","last_fullsized":"2024-09-10T21:06:13.106078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:30.575576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755368+0000","last_change":"2024-09-10T21:06:06.735638+0000","last_active":"2024-09-10T21:06:12.755368+0000","last_peered":"2024-09-10T21:06:12.755368+0000","last_clean":"2024-09-10T21:06:12.755368+0000","last_became_active":"2024-09-10T21:06:06.735293+0000","last_became_peered":"2024-09-10T21:06:06.735293+0000","last_unstale":"2024-09-10T21:06:12.755368+0000","last_undegraded":"2024-09-10T21:06:12.755368+0000","last_fullsized":"2024-09-10T21:06:12.755368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:24.628433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106316+0000","last_change":"2024-09-10T21:06:11.764039+0000","last_active":"2024-09-10T21:06:13.106316+0000","last_peered":"2024-09-10T21:06:13.106316+0000","last_clean":"2024-09-10T21:06:13.106316+0000","last_became_active":"2024-09-10T21:06:11.763682+0000","last_became_peered":"2024-09-10T21:06:11.763682+0000","last_unstale":"2024-09-10T21:06:13.106316+0000","last_undegraded":"2024-09-10T21:06:13.106316+0000","last_fullsized":"2024-09-10T21:06:13.106316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:16.839314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751619+0000","last_change":"2024-09-10T21:06:07.738236+0000","last_active":"2024-09-10T21:06:12.751619+0000","last_peered":"2024-09-10T21:06:12.751619+0000","last_clean":"2024-09-10T21:06:12.751619+0000","last_became_active":"2024-09-10T21:06:07.737917+0000","last_became_peered":"2024-09-10T21:06:07.737917+0000","last_unstale":"2024-09-10T21:06:12.751619+0000","last_undegraded":"2024-09-10T21:06:12.751619+0000","last_fullsized":"2024-09-10T21:06:12.751619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:55.077742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:20.089669+0000","last_change":"2024-09-10T21:06:06.731715+0000","last_active":"2024-09-10T21:06:20.089669+0000","last_peered":"2024-09-10T21:06:20.089669+0000","last_clean":"2024-09-10T21:06:20.089669+0000","last_became_active":"2024-09-10T21:06:06.731420+0000","last_became_peered":"2024-09-10T21:06:06.731420+0000","last_unstale":"2024-09-10T21:06:20.089669+0000","last_undegraded":"2024-09-10T21:06:20.089669+0000","last_fullsized":"2024-09-10T21:06:20.089669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:33.538737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106144+0000","last_change":"2024-09-10T21:06:11.762541+0000","last_active":"2024-09-10T21:06:13.106144+0000","last_peered":"2024-09-10T21:06:13.106144+0000","last_clean":"2024-09-10T21:06:13.106144+0000","last_became_active":"2024-09-10T21:06:11.762102+0000","last_became_peered":"2024-09-10T21:06:11.762102+0000","last_unstale":"2024-09-10T21:06:13.106144+0000","last_undegraded":"2024-09-10T21:06:13.106144+0000","last_fullsized":"2024-09-10T21:06:13.106144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:59.114459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106254+0000","last_change":"2024-09-10T21:06:07.724490+0000","last_active":"2024-09-10T21:06:13.106254+0000","last_peered":"2024-09-10T21:06:13.106254+0000","last_clean":"2024-09-10T21:06:13.106254+0000","last_became_active":"2024-09-10T21:06:07.724157+0000","last_became_peered":"2024-09-10T21:06:07.724157+0000","last_unstale":"2024-09-10T21:06:13.106254+0000","last_undegraded":"2024-09-10T21:06:13.106254+0000","last_fullsized":"2024-09-10T21:06:13.106254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:23.477983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755368+0000","last_change":"2024-09-10T21:06:06.739360+0000","last_active":"2024-09-10T21:06:12.755368+0000","last_peered":"2024-09-10T21:06:12.755368+0000","last_clean":"2024-09-10T21:06:12.755368+0000","last_became_active":"2024-09-10T21:06:06.739136+0000","last_became_peered":"2024-09-10T21:06:06.739136+0000","last_unstale":"2024-09-10T21:06:12.755368+0000","last_undegraded":"2024-09-10T21:06:12.755368+0000","last_fullsized":"2024-09-10T21:06:12.755368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:42.131131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106640+0000","last_change":"2024-09-10T21:06:11.775845+0000","last_active":"2024-09-10T21:06:13.106640+0000","last_peered":"2024-09-10T21:06:13.106640+0000","last_clean":"2024-09-10T21:06:13.106640+0000","last_became_active":"2024-09-10T21:06:11.775460+0000","last_became_peered":"2024-09-10T21:06:11.775460+0000","last_unstale":"2024-09-10T21:06:13.106640+0000","last_undegraded":"2024-09-10T21:06:13.106640+0000","last_fullsized":"2024-09-10T21:06:13.106640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.820369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096792+0000","last_change":"2024-09-10T21:06:07.732030+0000","last_active":"2024-09-10T21:06:13.096792+0000","last_peered":"2024-09-10T21:06:13.096792+0000","last_clean":"2024-09-10T21:06:13.096792+0000","last_became_active":"2024-09-10T21:06:07.731726+0000","last_became_peered":"2024-09-10T21:06:07.731726+0000","last_unstale":"2024-09-10T21:06:13.096792+0000","last_undegraded":"2024-09-10T21:06:13.096792+0000","last_fullsized":"2024-09-10T21:06:13.096792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:51.701343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751643+0000","last_change":"2024-09-10T21:06:06.724643+0000","last_active":"2024-09-10T21:06:12.751643+0000","last_peered":"2024-09-10T21:06:12.751643+0000","last_clean":"2024-09-10T21:06:12.751643+0000","last_became_active":"2024-09-10T21:06:06.724348+0000","last_became_peered":"2024-09-10T21:06:06.724348+0000","last_unstale":"2024-09-10T21:06:12.751643+0000","last_undegraded":"2024-09-10T21:06:12.751643+0000","last_fullsized":"2024-09-10T21:06:12.751643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:14.047312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754380+0000","last_change":"2024-09-10T21:06:11.772999+0000","last_active":"2024-09-10T21:06:12.754380+0000","last_peered":"2024-09-10T21:06:12.754380+0000","last_clean":"2024-09-10T21:06:12.754380+0000","last_became_active":"2024-09-10T21:06:11.771544+0000","last_became_peered":"2024-09-10T21:06:11.771544+0000","last_unstale":"2024-09-10T21:06:12.754380+0000","last_undegraded":"2024-09-10T21:06:12.754380+0000","last_fullsized":"2024-09-10T21:06:12.754380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:10.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107606+0000","last_change":"2024-09-10T21:06:07.737581+0000","last_active":"2024-09-10T21:06:13.107606+0000","last_peered":"2024-09-10T21:06:13.107606+0000","last_clean":"2024-09-10T21:06:13.107606+0000","last_became_active":"2024-09-10T21:06:07.737246+0000","last_became_peered":"2024-09-10T21:06:07.737246+0000","last_unstale":"2024-09-10T21:06:13.107606+0000","last_undegraded":"2024-09-10T21:06:13.107606+0000","last_fullsized":"2024-09-10T21:06:13.107606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755005+0000","last_change":"2024-09-10T21:06:06.736661+0000","last_active":"2024-09-10T21:06:12.755005+0000","last_peered":"2024-09-10T21:06:12.755005+0000","last_clean":"2024-09-10T21:06:12.755005+0000","last_became_active":"2024-09-10T21:06:06.736356+0000","last_became_peered":"2024-09-10T21:06:06.736356+0000","last_unstale":"2024-09-10T21:06:12.755005+0000","last_undegraded":"2024-09-10T21:06:12.755005+0000","last_fullsized":"2024-09-10T21:06:12.755005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:20.425789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105911+0000","last_change":"2024-09-10T21:06:11.760467+0000","last_active":"2024-09-10T21:06:13.105911+0000","last_peered":"2024-09-10T21:06:13.105911+0000","last_clean":"2024-09-10T21:06:13.105911+0000","last_became_active":"2024-09-10T21:06:11.760101+0000","last_became_peered":"2024-09-10T21:06:11.760101+0000","last_unstale":"2024-09-10T21:06:13.105911+0000","last_undegraded":"2024-09-10T21:06:13.105911+0000","last_fullsized":"2024-09-10T21:06:13.105911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:03.280132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106059+0000","last_change":"2024-09-10T21:06:11.763190+0000","last_active":"2024-09-10T21:06:13.106059+0000","last_peered":"2024-09-10T21:06:13.106059+0000","last_clean":"2024-09-10T21:06:13.106059+0000","last_became_active":"2024-09-10T21:06:11.758968+0000","last_became_peered":"2024-09-10T21:06:11.758968+0000","last_unstale":"2024-09-10T21:06:13.106059+0000","last_undegraded":"2024-09-10T21:06:13.106059+0000","last_fullsized":"2024-09-10T21:06:13.106059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:16.821284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106076+0000","last_change":"2024-09-10T21:06:07.747586+0000","last_active":"2024-09-10T21:06:13.106076+0000","last_peered":"2024-09-10T21:06:13.106076+0000","last_clean":"2024-09-10T21:06:13.106076+0000","last_became_active":"2024-09-10T21:06:07.745029+0000","last_became_peered":"2024-09-10T21:06:07.745029+0000","last_unstale":"2024-09-10T21:06:13.106076+0000","last_undegraded":"2024-09-10T21:06:13.106076+0000","last_fullsized":"2024-09-10T21:06:13.106076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.948769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105798+0000","last_change":"2024-09-10T21:06:06.719711+0000","last_active":"2024-09-10T21:06:13.105798+0000","last_peered":"2024-09-10T21:06:13.105798+0000","last_clean":"2024-09-10T21:06:13.105798+0000","last_became_active":"2024-09-10T21:06:06.719461+0000","last_became_peered":"2024-09-10T21:06:06.719461+0000","last_unstale":"2024-09-10T21:06:13.105798+0000","last_undegraded":"2024-09-10T21:06:13.105798+0000","last_fullsized":"2024-09-10T21:06:13.105798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:05.884744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106296+0000","last_change":"2024-09-10T21:06:11.763903+0000","last_active":"2024-09-10T21:06:13.106296+0000","last_peered":"2024-09-10T21:06:13.106296+0000","last_clean":"2024-09-10T21:06:13.106296+0000","last_became_active":"2024-09-10T21:06:11.763549+0000","last_became_peered":"2024-09-10T21:06:11.763549+0000","last_unstale":"2024-09-10T21:06:13.106296+0000","last_undegraded":"2024-09-10T21:06:13.106296+0000","last_fullsized":"2024-09-10T21:06:13.106296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:28.790789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095775+0000","last_change":"2024-09-10T21:06:07.736045+0000","last_active":"2024-09-10T21:06:13.095775+0000","last_peered":"2024-09-10T21:06:13.095775+0000","last_clean":"2024-09-10T21:06:13.095775+0000","last_became_active":"2024-09-10T21:06:07.733458+0000","last_became_peered":"2024-09-10T21:06:07.733458+0000","last_unstale":"2024-09-10T21:06:13.095775+0000","last_undegraded":"2024-09-10T21:06:13.095775+0000","last_fullsized":"2024-09-10T21:06:13.095775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:31.627773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105575+0000","last_change":"2024-09-10T21:06:06.729442+0000","last_active":"2024-09-10T21:06:13.105575+0000","last_peered":"2024-09-10T21:06:13.105575+0000","last_clean":"2024-09-10T21:06:13.105575+0000","last_became_active":"2024-09-10T21:06:06.729045+0000","last_became_peered":"2024-09-10T21:06:06.729045+0000","last_unstale":"2024-09-10T21:06:13.105575+0000","last_undegraded":"2024-09-10T21:06:13.105575+0000","last_fullsized":"2024-09-10T21:06:13.105575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:35.821653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105776+0000","last_change":"2024-09-10T21:06:06.728511+0000","last_active":"2024-09-10T21:06:13.105776+0000","last_peered":"2024-09-10T21:06:13.105776+0000","last_clean":"2024-09-10T21:06:13.105776+0000","last_became_active":"2024-09-10T21:06:06.728200+0000","last_became_peered":"2024-09-10T21:06:06.728200+0000","last_unstale":"2024-09-10T21:06:13.105776+0000","last_undegraded":"2024-09-10T21:06:13.105776+0000","last_fullsized":"2024-09-10T21:06:13.105776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:30.893513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106622+0000","last_change":"2024-09-10T21:06:07.750023+0000","last_active":"2024-09-10T21:06:13.106622+0000","last_peered":"2024-09-10T21:06:13.106622+0000","last_clean":"2024-09-10T21:06:13.106622+0000","last_became_active":"2024-09-10T21:06:07.749735+0000","last_became_peered":"2024-09-10T21:06:07.749735+0000","last_unstale":"2024-09-10T21:06:13.106622+0000","last_undegraded":"2024-09-10T21:06:13.106622+0000","last_fullsized":"2024-09-10T21:06:13.106622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:09.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106429+0000","last_change":"2024-09-10T21:06:11.764282+0000","last_active":"2024-09-10T21:06:13.106429+0000","last_peered":"2024-09-10T21:06:13.106429+0000","last_clean":"2024-09-10T21:06:13.106429+0000","last_became_active":"2024-09-10T21:06:11.763052+0000","last_became_peered":"2024-09-10T21:06:11.763052+0000","last_unstale":"2024-09-10T21:06:13.106429+0000","last_undegraded":"2024-09-10T21:06:13.106429+0000","last_fullsized":"2024-09-10T21:06:13.106429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:49.419399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096049+0000","last_change":"2024-09-10T21:06:06.724502+0000","last_active":"2024-09-10T21:06:13.096049+0000","last_peered":"2024-09-10T21:06:13.096049+0000","last_clean":"2024-09-10T21:06:13.096049+0000","last_became_active":"2024-09-10T21:06:06.723257+0000","last_became_peered":"2024-09-10T21:06:06.723257+0000","last_unstale":"2024-09-10T21:06:13.096049+0000","last_undegraded":"2024-09-10T21:06:13.096049+0000","last_fullsized":"2024-09-10T21:06:13.096049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:33.839048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754544+0000","last_change":"2024-09-10T21:06:07.731233+0000","last_active":"2024-09-10T21:06:12.754544+0000","last_peered":"2024-09-10T21:06:12.754544+0000","last_clean":"2024-09-10T21:06:12.754544+0000","last_became_active":"2024-09-10T21:06:07.730548+0000","last_became_peered":"2024-09-10T21:06:07.730548+0000","last_unstale":"2024-09-10T21:06:12.754544+0000","last_undegraded":"2024-09-10T21:06:12.754544+0000","last_fullsized":"2024-09-10T21:06:12.754544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755250+0000","last_change":"2024-09-10T21:06:11.774785+0000","last_active":"2024-09-10T21:06:12.755250+0000","last_peered":"2024-09-10T21:06:12.755250+0000","last_clean":"2024-09-10T21:06:12.755250+0000","last_became_active":"2024-09-10T21:06:11.774346+0000","last_became_peered":"2024-09-10T21:06:11.774346+0000","last_unstale":"2024-09-10T21:06:12.755250+0000","last_undegraded":"2024-09-10T21:06:12.755250+0000","last_fullsized":"2024-09-10T21:06:12.755250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:02.110289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105230+0000","last_change":"2024-09-10T21:06:07.740108+0000","last_active":"2024-09-10T21:06:13.105230+0000","last_peered":"2024-09-10T21:06:13.105230+0000","last_clean":"2024-09-10T21:06:13.105230+0000","last_became_active":"2024-09-10T21:06:07.739794+0000","last_became_peered":"2024-09-10T21:06:07.739794+0000","last_unstale":"2024-09-10T21:06:13.105230+0000","last_undegraded":"2024-09-10T21:06:13.105230+0000","last_fullsized":"2024-09-10T21:06:13.105230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754458+0000","last_change":"2024-09-10T21:06:07.733770+0000","last_active":"2024-09-10T21:06:12.754458+0000","last_peered":"2024-09-10T21:06:12.754458+0000","last_clean":"2024-09-10T21:06:12.754458+0000","last_became_active":"2024-09-10T21:06:07.733519+0000","last_became_peered":"2024-09-10T21:06:07.733519+0000","last_unstale":"2024-09-10T21:06:12.754458+0000","last_undegraded":"2024-09-10T21:06:12.754458+0000","last_fullsized":"2024-09-10T21:06:12.754458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105599+0000","last_change":"2024-09-10T21:06:07.722573+0000","last_active":"2024-09-10T21:06:13.105599+0000","last_peered":"2024-09-10T21:06:13.105599+0000","last_clean":"2024-09-10T21:06:13.105599+0000","last_became_active":"2024-09-10T21:06:07.722291+0000","last_became_peered":"2024-09-10T21:06:07.722291+0000","last_unstale":"2024-09-10T21:06:13.105599+0000","last_undegraded":"2024-09-10T21:06:13.105599+0000","last_fullsized":"2024-09-10T21:06:13.105599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:24.676940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095949+0000","last_change":"2024-09-10T21:06:07.725057+0000","last_active":"2024-09-10T21:06:13.095949+0000","last_peered":"2024-09-10T21:06:13.095949+0000","last_clean":"2024-09-10T21:06:13.095949+0000","last_became_active":"2024-09-10T21:06:07.724777+0000","last_became_peered":"2024-09-10T21:06:07.724777+0000","last_unstale":"2024-09-10T21:06:13.095949+0000","last_undegraded":"2024-09-10T21:06:13.095949+0000","last_fullsized":"2024-09-10T21:06:13.095949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:05.565224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106908+0000","last_change":"2024-09-10T21:06:07.735771+0000","last_active":"2024-09-10T21:06:13.106908+0000","last_peered":"2024-09-10T21:06:13.106908+0000","last_clean":"2024-09-10T21:06:13.106908+0000","last_became_active":"2024-09-10T21:06:07.735447+0000","last_became_peered":"2024-09-10T21:06:07.735447+0000","last_unstale":"2024-09-10T21:06:13.106908+0000","last_undegraded":"2024-09-10T21:06:13.106908+0000","last_fullsized":"2024-09-10T21:06:13.106908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:21.629321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107117+0000","last_change":"2024-09-10T21:06:07.726407+0000","last_active":"2024-09-10T21:06:13.107117+0000","last_peered":"2024-09-10T21:06:13.107117+0000","last_clean":"2024-09-10T21:06:13.107117+0000","last_became_active":"2024-09-10T21:06:07.726061+0000","last_became_peered":"2024-09-10T21:06:07.726061+0000","last_unstale":"2024-09-10T21:06:13.107117+0000","last_undegraded":"2024-09-10T21:06:13.107117+0000","last_fullsized":"2024-09-10T21:06:13.107117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:23.671822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107518+0000","last_change":"2024-09-10T21:06:07.737552+0000","last_active":"2024-09-10T21:06:13.107518+0000","last_peered":"2024-09-10T21:06:13.107518+0000","last_clean":"2024-09-10T21:06:13.107518+0000","last_became_active":"2024-09-10T21:06:07.737253+0000","last_became_peered":"2024-09-10T21:06:07.737253+0000","last_unstale":"2024-09-10T21:06:13.107518+0000","last_undegraded":"2024-09-10T21:06:13.107518+0000","last_fullsized":"2024-09-10T21:06:13.107518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:43.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096602+0000","last_change":"2024-09-10T21:06:07.738429+0000","last_active":"2024-09-10T21:06:13.096602+0000","last_peered":"2024-09-10T21:06:13.096602+0000","last_clean":"2024-09-10T21:06:13.096602+0000","last_became_active":"2024-09-10T21:06:07.736750+0000","last_became_peered":"2024-09-10T21:06:07.736750+0000","last_unstale":"2024-09-10T21:06:13.096602+0000","last_undegraded":"2024-09-10T21:06:13.096602+0000","last_fullsized":"2024-09-10T21:06:13.096602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:15.172285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105703+0000","last_change":"2024-09-10T21:06:07.727750+0000","last_active":"2024-09-10T21:06:13.105703+0000","last_peered":"2024-09-10T21:06:13.105703+0000","last_clean":"2024-09-10T21:06:13.105703+0000","last_became_active":"2024-09-10T21:06:07.727492+0000","last_became_peered":"2024-09-10T21:06:07.727492+0000","last_unstale":"2024-09-10T21:06:13.105703+0000","last_undegraded":"2024-09-10T21:06:13.105703+0000","last_fullsized":"2024-09-10T21:06:13.105703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:45.382683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095636+0000","last_change":"2024-09-10T21:06:07.734497+0000","last_active":"2024-09-10T21:06:13.095636+0000","last_peered":"2024-09-10T21:06:13.095636+0000","last_clean":"2024-09-10T21:06:13.095636+0000","last_became_active":"2024-09-10T21:06:07.731837+0000","last_became_peered":"2024-09-10T21:06:07.731837+0000","last_unstale":"2024-09-10T21:06:13.095636+0000","last_undegraded":"2024-09-10T21:06:13.095636+0000","last_fullsized":"2024-09-10T21:06:13.095636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:10.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754456+0000","last_change":"2024-09-10T21:06:07.731385+0000","last_active":"2024-09-10T21:06:12.754456+0000","last_peered":"2024-09-10T21:06:12.754456+0000","last_clean":"2024-09-10T21:06:12.754456+0000","last_became_active":"2024-09-10T21:06:07.730952+0000","last_became_peered":"2024-09-10T21:06:07.730952+0000","last_unstale":"2024-09-10T21:06:12.754456+0000","last_undegraded":"2024-09-10T21:06:12.754456+0000","last_fullsized":"2024-09-10T21:06:12.754456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106509+0000","last_change":"2024-09-10T21:06:07.743829+0000","last_active":"2024-09-10T21:06:13.106509+0000","last_peered":"2024-09-10T21:06:13.106509+0000","last_clean":"2024-09-10T21:06:13.106509+0000","last_became_active":"2024-09-10T21:06:07.743556+0000","last_became_peered":"2024-09-10T21:06:07.743556+0000","last_unstale":"2024-09-10T21:06:13.106509+0000","last_undegraded":"2024-09-10T21:06:13.106509+0000","last_fullsized":"2024-09-10T21:06:13.106509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:58.073572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751609+0000","last_change":"2024-09-10T21:06:07.731428+0000","last_active":"2024-09-10T21:06:12.751609+0000","last_peered":"2024-09-10T21:06:12.751609+0000","last_clean":"2024-09-10T21:06:12.751609+0000","last_became_active":"2024-09-10T21:06:07.731151+0000","last_became_peered":"2024-09-10T21:06:07.731151+0000","last_unstale":"2024-09-10T21:06:12.751609+0000","last_undegraded":"2024-09-10T21:06:12.751609+0000","last_fullsized":"2024-09-10T21:06:12.751609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:10.318478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106834+0000","last_change":"2024-09-10T21:06:07.729264+0000","last_active":"2024-09-10T21:06:13.106834+0000","last_peered":"2024-09-10T21:06:13.106834+0000","last_clean":"2024-09-10T21:06:13.106834+0000","last_became_active":"2024-09-10T21:06:07.729001+0000","last_became_peered":"2024-09-10T21:06:07.729001+0000","last_unstale":"2024-09-10T21:06:13.106834+0000","last_undegraded":"2024-09-10T21:06:13.106834+0000","last_fullsized":"2024-09-10T21:06:13.106834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:13.030165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754965+0000","last_change":"2024-09-10T21:06:07.729035+0000","last_active":"2024-09-10T21:06:12.754965+0000","last_peered":"2024-09-10T21:06:12.754965+0000","last_clean":"2024-09-10T21:06:12.754965+0000","last_became_active":"2024-09-10T21:06:07.728726+0000","last_became_peered":"2024-09-10T21:06:07.728726+0000","last_unstale":"2024-09-10T21:06:12.754965+0000","last_undegraded":"2024-09-10T21:06:12.754965+0000","last_fullsized":"2024-09-10T21:06:12.754965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107040+0000","last_change":"2024-09-10T21:06:07.727552+0000","last_active":"2024-09-10T21:06:13.107040+0000","last_peered":"2024-09-10T21:06:13.107040+0000","last_clean":"2024-09-10T21:06:13.107040+0000","last_became_active":"2024-09-10T21:06:07.727247+0000","last_became_peered":"2024-09-10T21:06:07.727247+0000","last_unstale":"2024-09-10T21:06:13.107040+0000","last_undegraded":"2024-09-10T21:06:13.107040+0000","last_fullsized":"2024-09-10T21:06:13.107040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:17.742182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105603+0000","last_change":"2024-09-10T21:06:07.724043+0000","last_active":"2024-09-10T21:06:13.105603+0000","last_peered":"2024-09-10T21:06:13.105603+0000","last_clean":"2024-09-10T21:06:13.105603+0000","last_became_active":"2024-09-10T21:06:07.723760+0000","last_became_peered":"2024-09-10T21:06:07.723760+0000","last_unstale":"2024-09-10T21:06:13.105603+0000","last_undegraded":"2024-09-10T21:06:13.105603+0000","last_fullsized":"2024-09-10T21:06:13.105603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:31.704899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095465+0000","last_change":"2024-09-10T21:06:07.731993+0000","last_active":"2024-09-10T21:06:13.095465+0000","last_peered":"2024-09-10T21:06:13.095465+0000","last_clean":"2024-09-10T21:06:13.095465+0000","last_became_active":"2024-09-10T21:06:07.728201+0000","last_became_peered":"2024-09-10T21:06:07.728201+0000","last_unstale":"2024-09-10T21:06:13.095465+0000","last_undegraded":"2024-09-10T21:06:13.095465+0000","last_fullsized":"2024-09-10T21:06:13.095465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:37.030681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105964+0000","last_change":"2024-09-10T21:06:07.726441+0000","last_active":"2024-09-10T21:06:13.105964+0000","last_peered":"2024-09-10T21:06:13.105964+0000","last_clean":"2024-09-10T21:06:13.105964+0000","last_became_active":"2024-09-10T21:06:07.726129+0000","last_became_peered":"2024-09-10T21:06:07.726129+0000","last_unstale":"2024-09-10T21:06:13.105964+0000","last_undegraded":"2024-09-10T21:06:13.105964+0000","last_fullsized":"2024-09-10T21:06:13.105964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:50.280191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106522+0000","last_change":"2024-09-10T21:06:07.745674+0000","last_active":"2024-09-10T21:06:13.106522+0000","last_peered":"2024-09-10T21:06:13.106522+0000","last_clean":"2024-09-10T21:06:13.106522+0000","last_became_active":"2024-09-10T21:06:07.745377+0000","last_became_peered":"2024-09-10T21:06:07.745377+0000","last_unstale":"2024-09-10T21:06:13.106522+0000","last_undegraded":"2024-09-10T21:06:13.106522+0000","last_fullsized":"2024-09-10T21:06:13.106522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:58.465613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751580+0000","last_change":"2024-09-10T21:06:07.742353+0000","last_active":"2024-09-10T21:06:12.751580+0000","last_peered":"2024-09-10T21:06:12.751580+0000","last_clean":"2024-09-10T21:06:12.751580+0000","last_became_active":"2024-09-10T21:06:07.741768+0000","last_became_peered":"2024-09-10T21:06:07.741768+0000","last_unstale":"2024-09-10T21:06:12.751580+0000","last_undegraded":"2024-09-10T21:06:12.751580+0000","last_fullsized":"2024-09-10T21:06:12.751580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:21.303563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751664+0000","last_change":"2024-09-10T21:06:07.750182+0000","last_active":"2024-09-10T21:06:12.751664+0000","last_peered":"2024-09-10T21:06:12.751664+0000","last_clean":"2024-09-10T21:06:12.751664+0000","last_became_active":"2024-09-10T21:06:07.749545+0000","last_became_peered":"2024-09-10T21:06:07.749545+0000","last_unstale":"2024-09-10T21:06:12.751664+0000","last_undegraded":"2024-09-10T21:06:12.751664+0000","last_fullsized":"2024-09-10T21:06:12.751664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:01.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751610+0000","last_change":"2024-09-10T21:06:07.744262+0000","last_active":"2024-09-10T21:06:12.751610+0000","last_peered":"2024-09-10T21:06:12.751610+0000","last_clean":"2024-09-10T21:06:12.751610+0000","last_became_active":"2024-09-10T21:06:07.732781+0000","last_became_peered":"2024-09-10T21:06:07.732781+0000","last_unstale":"2024-09-10T21:06:12.751610+0000","last_undegraded":"2024-09-10T21:06:12.751610+0000","last_fullsized":"2024-09-10T21:06:12.751610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:58.650133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754980+0000","last_change":"2024-09-10T21:06:07.733975+0000","last_active":"2024-09-10T21:06:12.754980+0000","last_peered":"2024-09-10T21:06:12.754980+0000","last_clean":"2024-09-10T21:06:12.754980+0000","last_became_active":"2024-09-10T21:06:07.733715+0000","last_became_peered":"2024-09-10T21:06:07.733715+0000","last_unstale":"2024-09-10T21:06:12.754980+0000","last_undegraded":"2024-09-10T21:06:12.754980+0000","last_fullsized":"2024-09-10T21:06:12.754980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095474+0000","last_change":"2024-09-10T21:06:07.739522+0000","last_active":"2024-09-10T21:06:13.095474+0000","last_peered":"2024-09-10T21:06:13.095474+0000","last_clean":"2024-09-10T21:06:13.095474+0000","last_became_active":"2024-09-10T21:06:07.739162+0000","last_became_peered":"2024-09-10T21:06:07.739162+0000","last_unstale":"2024-09-10T21:06:13.095474+0000","last_undegraded":"2024-09-10T21:06:13.095474+0000","last_fullsized":"2024-09-10T21:06:13.095474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:03.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751051+0000","last_change":"2024-09-10T21:06:07.728083+0000","last_active":"2024-09-10T21:06:12.751051+0000","last_peered":"2024-09-10T21:06:12.751051+0000","last_clean":"2024-09-10T21:06:12.751051+0000","last_became_active":"2024-09-10T21:06:07.727804+0000","last_became_peered":"2024-09-10T21:06:07.727804+0000","last_unstale":"2024-09-10T21:06:12.751051+0000","last_undegraded":"2024-09-10T21:06:12.751051+0000","last_fullsized":"2024-09-10T21:06:12.751051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:04.725083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106825+0000","last_change":"2024-09-10T21:06:07.741270+0000","last_active":"2024-09-10T21:06:13.106825+0000","last_peered":"2024-09-10T21:06:13.106825+0000","last_clean":"2024-09-10T21:06:13.106825+0000","last_became_active":"2024-09-10T21:06:07.740584+0000","last_became_peered":"2024-09-10T21:06:07.740584+0000","last_unstale":"2024-09-10T21:06:13.106825+0000","last_undegraded":"2024-09-10T21:06:13.106825+0000","last_fullsized":"2024-09-10T21:06:13.106825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:52.489450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751331+0000","last_change":"2024-09-10T21:06:07.745169+0000","last_active":"2024-09-10T21:06:12.751331+0000","last_peered":"2024-09-10T21:06:12.751331+0000","last_clean":"2024-09-10T21:06:12.751331+0000","last_became_active":"2024-09-10T21:06:07.744772+0000","last_became_peered":"2024-09-10T21:06:07.744772+0000","last_unstale":"2024-09-10T21:06:12.751331+0000","last_undegraded":"2024-09-10T21:06:12.751331+0000","last_fullsized":"2024-09-10T21:06:12.751331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:03.406166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106982+0000","last_change":"2024-09-10T21:06:07.736065+0000","last_active":"2024-09-10T21:06:13.106982+0000","last_peered":"2024-09-10T21:06:13.106982+0000","last_clean":"2024-09-10T21:06:13.106982+0000","last_became_active":"2024-09-10T21:06:07.735732+0000","last_became_peered":"2024-09-10T21:06:07.735732+0000","last_unstale":"2024-09-10T21:06:13.106982+0000","last_undegraded":"2024-09-10T21:06:13.106982+0000","last_fullsized":"2024-09-10T21:06:13.106982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095910+0000","last_change":"2024-09-10T21:06:07.739765+0000","last_active":"2024-09-10T21:06:13.095910+0000","last_peered":"2024-09-10T21:06:13.095910+0000","last_clean":"2024-09-10T21:06:13.095910+0000","last_became_active":"2024-09-10T21:06:07.739457+0000","last_became_peered":"2024-09-10T21:06:07.739457+0000","last_unstale":"2024-09-10T21:06:13.095910+0000","last_undegraded":"2024-09-10T21:06:13.095910+0000","last_fullsized":"2024-09-10T21:06:13.095910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:58.818281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096192+0000","last_change":"2024-09-10T21:06:07.735873+0000","last_active":"2024-09-10T21:06:13.096192+0000","last_peered":"2024-09-10T21:06:13.096192+0000","last_clean":"2024-09-10T21:06:13.096192+0000","last_became_active":"2024-09-10T21:06:07.735589+0000","last_became_peered":"2024-09-10T21:06:07.735589+0000","last_unstale":"2024-09-10T21:06:13.096192+0000","last_undegraded":"2024-09-10T21:06:13.096192+0000","last_fullsized":"2024-09-10T21:06:13.096192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:26.970429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751832+0000","last_change":"2024-09-10T21:06:07.748933+0000","last_active":"2024-09-10T21:06:12.751832+0000","last_peered":"2024-09-10T21:06:12.751832+0000","last_clean":"2024-09-10T21:06:12.751832+0000","last_became_active":"2024-09-10T21:06:07.748659+0000","last_became_peered":"2024-09-10T21:06:07.748659+0000","last_unstale":"2024-09-10T21:06:12.751832+0000","last_undegraded":"2024-09-10T21:06:12.751832+0000","last_fullsized":"2024-09-10T21:06:12.751832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:26.789804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:06:30.229 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:06:30.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.418+0000 7fba89400640 1 -- 172.21.15.100:0/1471474076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba84161140 msgr2=0x7fba840b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.418+0000 7fba89400640 1 --2- 172.21.15.100:0/1471474076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba84161140 0x7fba840b21c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba74005fd0 tx=0x7fba7402a540 comp rx=0 tx=0).stop 2024-09-10T21:06:30.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.418+0000 7fba89400640 1 -- 172.21.15.100:0/1471474076 shutdown_connections 2024-09-10T21:06:30.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.418+0000 7fba89400640 1 --2- 172.21.15.100:0/1471474076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba8406d060 0x7fba8406d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.418+0000 7fba89400640 1 --2- 172.21.15.100:0/1471474076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba84161140 0x7fba840b21c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.418+0000 7fba89400640 1 -- 172.21.15.100:0/1471474076 >> 172.21.15.100:0/1471474076 conn(0x7fba840d3ab0 msgr2=0x7fba840d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:30.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.418+0000 7fba89400640 1 -- 172.21.15.100:0/1471474076 shutdown_connections 2024-09-10T21:06:30.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.418+0000 7fba89400640 1 -- 172.21.15.100:0/1471474076 wait complete. 2024-09-10T21:06:30.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.419+0000 7fba89400640 1 Processor -- start 2024-09-10T21:06:30.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.420+0000 7fba89400640 1 -- start start 2024-09-10T21:06:30.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.420+0000 7fba89400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba8406d060 0x7fba840b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.420+0000 7fba89400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8406e0a0 0x7fba8415fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.420+0000 7fba89400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba84161140 0x7fba84160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.420+0000 7fba89400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba8406f170 con 0x7fba8406d060 2024-09-10T21:06:30.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.420+0000 7fba89400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fba8406eff0 con 0x7fba8406e0a0 2024-09-10T21:06:30.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.420+0000 7fba89400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fba84161520 con 0x7fba84161140 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba8406d060 0x7fba840b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba8406d060 0x7fba840b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35252/0 (socket says 172.21.15.100:35252) 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 -- 172.21.15.100:0/3739983632 learned_addr learned my addr 172.21.15.100:0/3739983632 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8406e0a0 0x7fba8415fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 -- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba84161140 msgr2=0x7fba84160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba84161140 0x7fba84160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 -- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8406e0a0 msgr2=0x7fba8415fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8406e0a0 0x7fba8415fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 -- 172.21.15.100:0/3739983632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8409e7a0 con 0x7fba8406d060 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8406e0a0 0x7fba8415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.421+0000 7fba83e00640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba8406d060 0x7fba840b4860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba74034040 tx=0x7fba740038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.422+0000 7fba7be00640 1 -- 172.21.15.100:0/3739983632 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7403e030 con 0x7fba8406d060 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.422+0000 7fba7be00640 1 -- 172.21.15.100:0/3739983632 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba74003d90 con 0x7fba8406d060 2024-09-10T21:06:30.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.422+0000 7fba7be00640 1 -- 172.21.15.100:0/3739983632 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba74035040 con 0x7fba8406d060 2024-09-10T21:06:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.422+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba840ccec0 con 0x7fba8406d060 2024-09-10T21:06:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.422+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba840cd480 con 0x7fba8406d060 2024-09-10T21:06:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.423+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8406e800 con 0x7fba8406d060 2024-09-10T21:06:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.424+0000 7fba7be00640 1 -- 172.21.15.100:0/3739983632 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fba740049e0 con 0x7fba8406d060 2024-09-10T21:06:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.425+0000 7fba7be00640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fba64077f70 0x7fba6407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.425+0000 7fba7be00640 1 -- 172.21.15.100:0/3739983632 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fba740bae80 con 0x7fba8406d060 2024-09-10T21:06:30.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.426+0000 7fba83400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fba64077f70 0x7fba6407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.426+0000 7fba83400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fba64077f70 0x7fba6407a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba840a1890 tx=0x7fba70009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.430+0000 7fba7be00640 1 -- 172.21.15.100:0/3739983632 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fba740835a0 con 0x7fba8406d060 2024-09-10T21:06:30.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.610+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba840d0b40 con 0x7fba64077f70 2024-09-10T21:06:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.616+0000 7fba7be00640 1 -- 172.21.15.100:0/3739983632 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fba840d0b40 con 0x7fba64077f70 2024-09-10T21:06:30.624 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:30.626 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fba64077f70 msgr2=0x7fba6407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fba64077f70 0x7fba6407a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fba840a1890 tx=0x7fba70009040 comp rx=0 tx=0).stop 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba8406d060 msgr2=0x7fba840b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba8406d060 0x7fba840b4860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba74034040 tx=0x7fba740038a0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 shutdown_connections 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba84161140 0x7fba84160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fba64077f70 0x7fba6407a430 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8406e0a0 0x7fba8415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 --2- 172.21.15.100:0/3739983632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba8406d060 0x7fba840b4860 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 >> 172.21.15.100:0/3739983632 conn(0x7fba840d3ab0 msgr2=0x7fba840ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 shutdown_connections 2024-09-10T21:06:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.620+0000 7fba89400640 1 -- 172.21.15.100:0/3739983632 wait complete. 2024-09-10T21:06:30.641 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-10T21:06:28.692001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3514368,"data_stored":2074536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003456"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106808+0000","last_change":"2024-09-10T21:06:06.737219+0000","last_active":"2024-09-10T21:06:13.106808+0000","last_peered":"2024-09-10T21:06:13.106808+0000","last_clean":"2024-09-10T21:06:13.106808+0000","last_became_active":"2024-09-10T21:06:06.736940+0000","last_became_peered":"2024-09-10T21:06:06.736940+0000","last_unstale":"2024-09-10T21:06:13.106808+0000","last_undegraded":"2024-09-10T21:06:13.106808+0000","last_fullsized":"2024-09-10T21:06:13.106808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096347+0000","last_change":"2024-09-10T21:06:07.729261+0000","last_active":"2024-09-10T21:06:13.096347+0000","last_peered":"2024-09-10T21:06:13.096347+0000","last_clean":"2024-09-10T21:06:13.096347+0000","last_became_active":"2024-09-10T21:06:07.728483+0000","last_became_peered":"2024-09-10T21:06:07.728483+0000","last_unstale":"2024-09-10T21:06:13.096347+0000","last_undegraded":"2024-09-10T21:06:13.096347+0000","last_fullsized":"2024-09-10T21:06:13.096347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:20.894078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754483+0000","last_change":"2024-09-10T21:06:11.772637+0000","last_active":"2024-09-10T21:06:12.754483+0000","last_peered":"2024-09-10T21:06:12.754483+0000","last_clean":"2024-09-10T21:06:12.754483+0000","last_became_active":"2024-09-10T21:06:11.771448+0000","last_became_peered":"2024-09-10T21:06:11.771448+0000","last_unstale":"2024-09-10T21:06:12.754483+0000","last_undegraded":"2024-09-10T21:06:12.754483+0000","last_fullsized":"2024-09-10T21:06:12.754483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:42.328984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096457+0000","last_change":"2024-09-10T21:06:06.732030+0000","last_active":"2024-09-10T21:06:13.096457+0000","last_peered":"2024-09-10T21:06:13.096457+0000","last_clean":"2024-09-10T21:06:13.096457+0000","last_became_active":"2024-09-10T21:06:06.731060+0000","last_became_peered":"2024-09-10T21:06:06.731060+0000","last_unstale":"2024-09-10T21:06:13.096457+0000","last_undegraded":"2024-09-10T21:06:13.096457+0000","last_fullsized":"2024-09-10T21:06:13.096457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:58.950962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096699+0000","last_change":"2024-09-10T21:06:07.738136+0000","last_active":"2024-09-10T21:06:13.096699+0000","last_peered":"2024-09-10T21:06:13.096699+0000","last_clean":"2024-09-10T21:06:13.096699+0000","last_became_active":"2024-09-10T21:06:07.737068+0000","last_became_peered":"2024-09-10T21:06:07.737068+0000","last_unstale":"2024-09-10T21:06:13.096699+0000","last_undegraded":"2024-09-10T21:06:13.096699+0000","last_fullsized":"2024-09-10T21:06:13.096699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:21.806911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105233+0000","last_change":"2024-09-10T21:06:11.779585+0000","last_active":"2024-09-10T21:06:13.105233+0000","last_peered":"2024-09-10T21:06:13.105233+0000","last_clean":"2024-09-10T21:06:13.105233+0000","last_became_active":"2024-09-10T21:06:11.779111+0000","last_became_peered":"2024-09-10T21:06:11.779111+0000","last_unstale":"2024-09-10T21:06:13.105233+0000","last_undegraded":"2024-09-10T21:06:13.105233+0000","last_fullsized":"2024-09-10T21:06:13.105233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:55.529656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751770+0000","last_change":"2024-09-10T21:06:06.730043+0000","last_active":"2024-09-10T21:06:12.751770+0000","last_peered":"2024-09-10T21:06:12.751770+0000","last_clean":"2024-09-10T21:06:12.751770+0000","last_became_active":"2024-09-10T21:06:06.729736+0000","last_became_peered":"2024-09-10T21:06:06.729736+0000","last_unstale":"2024-09-10T21:06:12.751770+0000","last_undegraded":"2024-09-10T21:06:12.751770+0000","last_fullsized":"2024-09-10T21:06:12.751770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:03.085613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754713+0000","last_change":"2024-09-10T21:06:07.749059+0000","last_active":"2024-09-10T21:06:12.754713+0000","last_peered":"2024-09-10T21:06:12.754713+0000","last_clean":"2024-09-10T21:06:12.754713+0000","last_became_active":"2024-09-10T21:06:07.748645+0000","last_became_peered":"2024-09-10T21:06:07.748645+0000","last_unstale":"2024-09-10T21:06:12.754713+0000","last_undegraded":"2024-09-10T21:06:12.754713+0000","last_fullsized":"2024-09-10T21:06:12.754713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:43.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106613+0000","last_change":"2024-09-10T21:06:11.774923+0000","last_active":"2024-09-10T21:06:13.106613+0000","last_peered":"2024-09-10T21:06:13.106613+0000","last_clean":"2024-09-10T21:06:13.106613+0000","last_became_active":"2024-09-10T21:06:11.774581+0000","last_became_peered":"2024-09-10T21:06:11.774581+0000","last_unstale":"2024-09-10T21:06:13.106613+0000","last_undegraded":"2024-09-10T21:06:13.106613+0000","last_fullsized":"2024-09-10T21:06:13.106613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:43.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751739+0000","last_change":"2024-09-10T21:06:06.725866+0000","last_active":"2024-09-10T21:06:12.751739+0000","last_peered":"2024-09-10T21:06:12.751739+0000","last_clean":"2024-09-10T21:06:12.751739+0000","last_became_active":"2024-09-10T21:06:06.725590+0000","last_became_peered":"2024-09-10T21:06:06.725590+0000","last_unstale":"2024-09-10T21:06:12.751739+0000","last_undegraded":"2024-09-10T21:06:12.751739+0000","last_fullsized":"2024-09-10T21:06:12.751739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106462+0000","last_change":"2024-09-10T21:06:07.748653+0000","last_active":"2024-09-10T21:06:13.106462+0000","last_peered":"2024-09-10T21:06:13.106462+0000","last_clean":"2024-09-10T21:06:13.106462+0000","last_became_active":"2024-09-10T21:06:07.748366+0000","last_became_peered":"2024-09-10T21:06:07.748366+0000","last_unstale":"2024-09-10T21:06:13.106462+0000","last_undegraded":"2024-09-10T21:06:13.106462+0000","last_fullsized":"2024-09-10T21:06:13.106462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:19.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105881+0000","last_change":"2024-09-10T21:06:11.768824+0000","last_active":"2024-09-10T21:06:13.105881+0000","last_peered":"2024-09-10T21:06:13.105881+0000","last_clean":"2024-09-10T21:06:13.105881+0000","last_became_active":"2024-09-10T21:06:11.768442+0000","last_became_peered":"2024-09-10T21:06:11.768442+0000","last_unstale":"2024-09-10T21:06:13.105881+0000","last_undegraded":"2024-09-10T21:06:13.105881+0000","last_fullsized":"2024-09-10T21:06:13.105881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:05.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105671+0000","last_change":"2024-09-10T21:06:07.733906+0000","last_active":"2024-09-10T21:06:13.105671+0000","last_peered":"2024-09-10T21:06:13.105671+0000","last_clean":"2024-09-10T21:06:13.105671+0000","last_became_active":"2024-09-10T21:06:07.733681+0000","last_became_peered":"2024-09-10T21:06:07.733681+0000","last_unstale":"2024-09-10T21:06:13.105671+0000","last_undegraded":"2024-09-10T21:06:13.105671+0000","last_fullsized":"2024-09-10T21:06:13.105671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:17.153627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106032+0000","last_change":"2024-09-10T21:06:06.732743+0000","last_active":"2024-09-10T21:06:13.106032+0000","last_peered":"2024-09-10T21:06:13.106032+0000","last_clean":"2024-09-10T21:06:13.106032+0000","last_became_active":"2024-09-10T21:06:06.732494+0000","last_became_peered":"2024-09-10T21:06:06.732494+0000","last_unstale":"2024-09-10T21:06:13.106032+0000","last_undegraded":"2024-09-10T21:06:13.106032+0000","last_fullsized":"2024-09-10T21:06:13.106032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:03.085613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107067+0000","last_change":"2024-09-10T21:06:11.777327+0000","last_active":"2024-09-10T21:06:13.107067+0000","last_peered":"2024-09-10T21:06:13.107067+0000","last_clean":"2024-09-10T21:06:13.107067+0000","last_became_active":"2024-09-10T21:06:11.771004+0000","last_became_peered":"2024-09-10T21:06:11.771004+0000","last_unstale":"2024-09-10T21:06:13.107067+0000","last_undegraded":"2024-09-10T21:06:13.107067+0000","last_fullsized":"2024-09-10T21:06:13.107067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:35.265715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755166+0000","last_change":"2024-09-10T21:06:07.734707+0000","last_active":"2024-09-10T21:06:12.755166+0000","last_peered":"2024-09-10T21:06:12.755166+0000","last_clean":"2024-09-10T21:06:12.755166+0000","last_became_active":"2024-09-10T21:06:07.733049+0000","last_became_peered":"2024-09-10T21:06:07.733049+0000","last_unstale":"2024-09-10T21:06:12.755166+0000","last_undegraded":"2024-09-10T21:06:12.755166+0000","last_fullsized":"2024-09-10T21:06:12.755166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106234+0000","last_change":"2024-09-10T21:06:06.720924+0000","last_active":"2024-09-10T21:06:13.106234+0000","last_peered":"2024-09-10T21:06:13.106234+0000","last_clean":"2024-09-10T21:06:13.106234+0000","last_became_active":"2024-09-10T21:06:06.719357+0000","last_became_peered":"2024-09-10T21:06:06.719357+0000","last_unstale":"2024-09-10T21:06:13.106234+0000","last_undegraded":"2024-09-10T21:06:13.106234+0000","last_fullsized":"2024-09-10T21:06:13.106234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:17.674783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751373+0000","last_change":"2024-09-10T21:06:11.771235+0000","last_active":"2024-09-10T21:06:12.751373+0000","last_peered":"2024-09-10T21:06:12.751373+0000","last_clean":"2024-09-10T21:06:12.751373+0000","last_became_active":"2024-09-10T21:06:11.770880+0000","last_became_peered":"2024-09-10T21:06:11.770880+0000","last_unstale":"2024-09-10T21:06:12.751373+0000","last_undegraded":"2024-09-10T21:06:12.751373+0000","last_fullsized":"2024-09-10T21:06:12.751373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:41.810392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105840+0000","last_change":"2024-09-10T21:06:07.736240+0000","last_active":"2024-09-10T21:06:13.105840+0000","last_peered":"2024-09-10T21:06:13.105840+0000","last_clean":"2024-09-10T21:06:13.105840+0000","last_became_active":"2024-09-10T21:06:07.735925+0000","last_became_peered":"2024-09-10T21:06:07.735925+0000","last_unstale":"2024-09-10T21:06:13.105840+0000","last_undegraded":"2024-09-10T21:06:13.105840+0000","last_fullsized":"2024-09-10T21:06:13.105840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:38.292268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106193+0000","last_change":"2024-09-10T21:06:06.736359+0000","last_active":"2024-09-10T21:06:13.106193+0000","last_peered":"2024-09-10T21:06:13.106193+0000","last_clean":"2024-09-10T21:06:13.106193+0000","last_became_active":"2024-09-10T21:06:06.736050+0000","last_became_peered":"2024-09-10T21:06:06.736050+0000","last_unstale":"2024-09-10T21:06:13.106193+0000","last_undegraded":"2024-09-10T21:06:13.106193+0000","last_fullsized":"2024-09-10T21:06:13.106193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:23.541255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755047+0000","last_change":"2024-09-10T21:06:11.777086+0000","last_active":"2024-09-10T21:06:12.755047+0000","last_peered":"2024-09-10T21:06:12.755047+0000","last_clean":"2024-09-10T21:06:12.755047+0000","last_became_active":"2024-09-10T21:06:11.775942+0000","last_became_peered":"2024-09-10T21:06:11.775942+0000","last_unstale":"2024-09-10T21:06:12.755047+0000","last_undegraded":"2024-09-10T21:06:12.755047+0000","last_fullsized":"2024-09-10T21:06:12.755047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:32.985485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105699+0000","last_change":"2024-09-10T21:06:07.733238+0000","last_active":"2024-09-10T21:06:13.105699+0000","last_peered":"2024-09-10T21:06:13.105699+0000","last_clean":"2024-09-10T21:06:13.105699+0000","last_became_active":"2024-09-10T21:06:07.732976+0000","last_became_peered":"2024-09-10T21:06:07.732976+0000","last_unstale":"2024-09-10T21:06:13.105699+0000","last_undegraded":"2024-09-10T21:06:13.105699+0000","last_fullsized":"2024-09-10T21:06:13.105699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.194600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.750898+0000","last_change":"2024-09-10T21:06:06.729612+0000","last_active":"2024-09-10T21:06:12.750898+0000","last_peered":"2024-09-10T21:06:12.750898+0000","last_clean":"2024-09-10T21:06:12.750898+0000","last_became_active":"2024-09-10T21:06:06.729273+0000","last_became_peered":"2024-09-10T21:06:06.729273+0000","last_unstale":"2024-09-10T21:06:12.750898+0000","last_undegraded":"2024-09-10T21:06:12.750898+0000","last_fullsized":"2024-09-10T21:06:12.750898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:31.995655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107550+0000","last_change":"2024-09-10T21:06:11.775010+0000","last_active":"2024-09-10T21:06:13.107550+0000","last_peered":"2024-09-10T21:06:13.107550+0000","last_clean":"2024-09-10T21:06:13.107550+0000","last_became_active":"2024-09-10T21:06:11.774620+0000","last_became_peered":"2024-09-10T21:06:11.774620+0000","last_unstale":"2024-09-10T21:06:13.107550+0000","last_undegraded":"2024-09-10T21:06:13.107550+0000","last_fullsized":"2024-09-10T21:06:13.107550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:16.623420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106018+0000","last_change":"2024-09-10T21:06:07.738509+0000","last_active":"2024-09-10T21:06:13.106018+0000","last_peered":"2024-09-10T21:06:13.106018+0000","last_clean":"2024-09-10T21:06:13.106018+0000","last_became_active":"2024-09-10T21:06:07.738191+0000","last_became_peered":"2024-09-10T21:06:07.738191+0000","last_unstale":"2024-09-10T21:06:13.106018+0000","last_undegraded":"2024-09-10T21:06:13.106018+0000","last_fullsized":"2024-09-10T21:06:13.106018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:55.563240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107096+0000","last_change":"2024-09-10T21:06:06.729882+0000","last_active":"2024-09-10T21:06:13.107096+0000","last_peered":"2024-09-10T21:06:13.107096+0000","last_clean":"2024-09-10T21:06:13.107096+0000","last_became_active":"2024-09-10T21:06:06.729598+0000","last_became_peered":"2024-09-10T21:06:06.729598+0000","last_unstale":"2024-09-10T21:06:13.107096+0000","last_undegraded":"2024-09-10T21:06:13.107096+0000","last_fullsized":"2024-09-10T21:06:13.107096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:53.297095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105187+0000","last_change":"2024-09-10T21:06:11.773911+0000","last_active":"2024-09-10T21:06:13.105187+0000","last_peered":"2024-09-10T21:06:13.105187+0000","last_clean":"2024-09-10T21:06:13.105187+0000","last_became_active":"2024-09-10T21:06:11.773571+0000","last_became_peered":"2024-09-10T21:06:11.773571+0000","last_unstale":"2024-09-10T21:06:13.105187+0000","last_undegraded":"2024-09-10T21:06:13.105187+0000","last_fullsized":"2024-09-10T21:06:13.105187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:59.082471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106726+0000","last_change":"2024-09-10T21:06:07.744529+0000","last_active":"2024-09-10T21:06:13.106726+0000","last_peered":"2024-09-10T21:06:13.106726+0000","last_clean":"2024-09-10T21:06:13.106726+0000","last_became_active":"2024-09-10T21:06:07.744283+0000","last_became_peered":"2024-09-10T21:06:07.744283+0000","last_unstale":"2024-09-10T21:06:13.106726+0000","last_undegraded":"2024-09-10T21:06:13.106726+0000","last_fullsized":"2024-09-10T21:06:13.106726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:22.708264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106805+0000","last_change":"2024-09-10T21:06:06.735762+0000","last_active":"2024-09-10T21:06:13.106805+0000","last_peered":"2024-09-10T21:06:13.106805+0000","last_clean":"2024-09-10T21:06:13.106805+0000","last_became_active":"2024-09-10T21:06:06.735504+0000","last_became_peered":"2024-09-10T21:06:06.735504+0000","last_unstale":"2024-09-10T21:06:13.106805+0000","last_undegraded":"2024-09-10T21:06:13.106805+0000","last_fullsized":"2024-09-10T21:06:13.106805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:30.893513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105651+0000","last_change":"2024-09-10T21:06:11.759166+0000","last_active":"2024-09-10T21:06:13.105651+0000","last_peered":"2024-09-10T21:06:13.105651+0000","last_clean":"2024-09-10T21:06:13.105651+0000","last_became_active":"2024-09-10T21:06:11.758731+0000","last_became_peered":"2024-09-10T21:06:11.758731+0000","last_unstale":"2024-09-10T21:06:13.105651+0000","last_undegraded":"2024-09-10T21:06:13.105651+0000","last_fullsized":"2024-09-10T21:06:13.105651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:35.741616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106957+0000","last_change":"2024-09-10T21:06:07.730449+0000","last_active":"2024-09-10T21:06:13.106957+0000","last_peered":"2024-09-10T21:06:13.106957+0000","last_clean":"2024-09-10T21:06:13.106957+0000","last_became_active":"2024-09-10T21:06:07.730138+0000","last_became_peered":"2024-09-10T21:06:07.730138+0000","last_unstale":"2024-09-10T21:06:13.106957+0000","last_undegraded":"2024-09-10T21:06:13.106957+0000","last_fullsized":"2024-09-10T21:06:13.106957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:52.489450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106921+0000","last_change":"2024-09-10T21:06:06.733157+0000","last_active":"2024-09-10T21:06:13.106921+0000","last_peered":"2024-09-10T21:06:13.106921+0000","last_clean":"2024-09-10T21:06:13.106921+0000","last_became_active":"2024-09-10T21:06:06.731969+0000","last_became_peered":"2024-09-10T21:06:06.731969+0000","last_unstale":"2024-09-10T21:06:13.106921+0000","last_undegraded":"2024-09-10T21:06:13.106921+0000","last_fullsized":"2024-09-10T21:06:13.106921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:29.608127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106173+0000","last_change":"2024-09-10T21:06:11.765210+0000","last_active":"2024-09-10T21:06:13.106173+0000","last_peered":"2024-09-10T21:06:13.106173+0000","last_clean":"2024-09-10T21:06:13.106173+0000","last_became_active":"2024-09-10T21:06:11.764692+0000","last_became_peered":"2024-09-10T21:06:11.764692+0000","last_unstale":"2024-09-10T21:06:13.106173+0000","last_undegraded":"2024-09-10T21:06:13.106173+0000","last_fullsized":"2024-09-10T21:06:13.106173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:43.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107298+0000","last_change":"2024-09-10T21:06:07.740729+0000","last_active":"2024-09-10T21:06:13.107298+0000","last_peered":"2024-09-10T21:06:13.107298+0000","last_clean":"2024-09-10T21:06:13.107298+0000","last_became_active":"2024-09-10T21:06:07.740268+0000","last_became_peered":"2024-09-10T21:06:07.740268+0000","last_unstale":"2024-09-10T21:06:13.107298+0000","last_undegraded":"2024-09-10T21:06:13.107298+0000","last_fullsized":"2024-09-10T21:06:13.107298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095917+0000","last_change":"2024-09-10T21:06:06.727108+0000","last_active":"2024-09-10T21:06:13.095917+0000","last_peered":"2024-09-10T21:06:13.095917+0000","last_clean":"2024-09-10T21:06:13.095917+0000","last_became_active":"2024-09-10T21:06:06.724197+0000","last_became_peered":"2024-09-10T21:06:06.724197+0000","last_unstale":"2024-09-10T21:06:13.095917+0000","last_undegraded":"2024-09-10T21:06:13.095917+0000","last_fullsized":"2024-09-10T21:06:13.095917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:42.221414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105780+0000","last_change":"2024-09-10T21:06:11.761088+0000","last_active":"2024-09-10T21:06:13.105780+0000","last_peered":"2024-09-10T21:06:13.105780+0000","last_clean":"2024-09-10T21:06:13.105780+0000","last_became_active":"2024-09-10T21:06:11.760606+0000","last_became_peered":"2024-09-10T21:06:11.760606+0000","last_unstale":"2024-09-10T21:06:13.105780+0000","last_undegraded":"2024-09-10T21:06:13.105780+0000","last_fullsized":"2024-09-10T21:06:13.105780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:55.529656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751220+0000","last_change":"2024-09-10T21:06:07.740212+0000","last_active":"2024-09-10T21:06:12.751220+0000","last_peered":"2024-09-10T21:06:12.751220+0000","last_clean":"2024-09-10T21:06:12.751220+0000","last_became_active":"2024-09-10T21:06:07.739862+0000","last_became_peered":"2024-09-10T21:06:07.739862+0000","last_unstale":"2024-09-10T21:06:12.751220+0000","last_undegraded":"2024-09-10T21:06:12.751220+0000","last_fullsized":"2024-09-10T21:06:12.751220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:59.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105875+0000","last_change":"2024-09-10T21:06:06.720349+0000","last_active":"2024-09-10T21:06:13.105875+0000","last_peered":"2024-09-10T21:06:13.105875+0000","last_clean":"2024-09-10T21:06:13.105875+0000","last_became_active":"2024-09-10T21:06:06.719193+0000","last_became_peered":"2024-09-10T21:06:06.719193+0000","last_unstale":"2024-09-10T21:06:13.105875+0000","last_undegraded":"2024-09-10T21:06:13.105875+0000","last_fullsized":"2024-09-10T21:06:13.105875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:14.047312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106576+0000","last_change":"2024-09-10T21:06:11.764876+0000","last_active":"2024-09-10T21:06:13.106576+0000","last_peered":"2024-09-10T21:06:13.106576+0000","last_clean":"2024-09-10T21:06:13.106576+0000","last_became_active":"2024-09-10T21:06:11.762830+0000","last_became_peered":"2024-09-10T21:06:11.762830+0000","last_unstale":"2024-09-10T21:06:13.106576+0000","last_undegraded":"2024-09-10T21:06:13.106576+0000","last_fullsized":"2024-09-10T21:06:13.106576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.820369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095486+0000","last_change":"2024-09-10T21:06:07.728902+0000","last_active":"2024-09-10T21:06:13.095486+0000","last_peered":"2024-09-10T21:06:13.095486+0000","last_clean":"2024-09-10T21:06:13.095486+0000","last_became_active":"2024-09-10T21:06:07.727554+0000","last_became_peered":"2024-09-10T21:06:07.727554+0000","last_unstale":"2024-09-10T21:06:13.095486+0000","last_undegraded":"2024-09-10T21:06:13.095486+0000","last_fullsized":"2024-09-10T21:06:13.095486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:30.750244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754573+0000","last_change":"2024-09-10T21:06:06.738792+0000","last_active":"2024-09-10T21:06:12.754573+0000","last_peered":"2024-09-10T21:06:12.754573+0000","last_clean":"2024-09-10T21:06:12.754573+0000","last_became_active":"2024-09-10T21:06:06.735261+0000","last_became_peered":"2024-09-10T21:06:06.735261+0000","last_unstale":"2024-09-10T21:06:12.754573+0000","last_undegraded":"2024-09-10T21:06:12.754573+0000","last_fullsized":"2024-09-10T21:06:12.754573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:04.060073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107278+0000","last_change":"2024-09-10T21:06:11.759571+0000","last_active":"2024-09-10T21:06:13.107278+0000","last_peered":"2024-09-10T21:06:13.107278+0000","last_clean":"2024-09-10T21:06:13.107278+0000","last_became_active":"2024-09-10T21:06:11.758333+0000","last_became_peered":"2024-09-10T21:06:11.758333+0000","last_unstale":"2024-09-10T21:06:13.107278+0000","last_undegraded":"2024-09-10T21:06:13.107278+0000","last_fullsized":"2024-09-10T21:06:13.107278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:19.666141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105462+0000","last_change":"2024-09-10T21:06:07.730355+0000","last_active":"2024-09-10T21:06:13.105462+0000","last_peered":"2024-09-10T21:06:13.105462+0000","last_clean":"2024-09-10T21:06:13.105462+0000","last_became_active":"2024-09-10T21:06:07.728407+0000","last_became_peered":"2024-09-10T21:06:07.728407+0000","last_unstale":"2024-09-10T21:06:13.105462+0000","last_undegraded":"2024-09-10T21:06:13.105462+0000","last_fullsized":"2024-09-10T21:06:13.105462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105889+0000","last_change":"2024-09-10T21:06:06.724834+0000","last_active":"2024-09-10T21:06:13.105889+0000","last_peered":"2024-09-10T21:06:13.105889+0000","last_clean":"2024-09-10T21:06:13.105889+0000","last_became_active":"2024-09-10T21:06:06.723605+0000","last_became_peered":"2024-09-10T21:06:06.723605+0000","last_unstale":"2024-09-10T21:06:13.105889+0000","last_undegraded":"2024-09-10T21:06:13.105889+0000","last_fullsized":"2024-09-10T21:06:13.105889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:49.300851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096160+0000","last_change":"2024-09-10T21:06:11.775310+0000","last_active":"2024-09-10T21:06:13.096160+0000","last_peered":"2024-09-10T21:06:13.096160+0000","last_clean":"2024-09-10T21:06:13.096160+0000","last_became_active":"2024-09-10T21:06:11.774927+0000","last_became_peered":"2024-09-10T21:06:11.774927+0000","last_unstale":"2024-09-10T21:06:13.096160+0000","last_undegraded":"2024-09-10T21:06:13.096160+0000","last_fullsized":"2024-09-10T21:06:13.096160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:57.504941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105855+0000","last_change":"2024-09-10T21:06:07.744943+0000","last_active":"2024-09-10T21:06:13.105855+0000","last_peered":"2024-09-10T21:06:13.105855+0000","last_clean":"2024-09-10T21:06:13.105855+0000","last_became_active":"2024-09-10T21:06:07.744127+0000","last_became_peered":"2024-09-10T21:06:07.744127+0000","last_unstale":"2024-09-10T21:06:13.105855+0000","last_undegraded":"2024-09-10T21:06:13.105855+0000","last_fullsized":"2024-09-10T21:06:13.105855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:56.096951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106075+0000","last_change":"2024-09-10T21:06:06.732794+0000","last_active":"2024-09-10T21:06:13.106075+0000","last_peered":"2024-09-10T21:06:13.106075+0000","last_clean":"2024-09-10T21:06:13.106075+0000","last_became_active":"2024-09-10T21:06:06.732524+0000","last_became_peered":"2024-09-10T21:06:06.732524+0000","last_unstale":"2024-09-10T21:06:13.106075+0000","last_undegraded":"2024-09-10T21:06:13.106075+0000","last_fullsized":"2024-09-10T21:06:13.106075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:52.521141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754500+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:06:12.754500+0000","last_peered":"2024-09-10T21:06:12.754500+0000","last_clean":"2024-09-10T21:06:12.754500+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:06:12.754500+0000","last_undegraded":"2024-09-10T21:06:12.754500+0000","last_fullsized":"2024-09-10T21:06:12.754500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106695+0000","last_change":"2024-09-10T21:06:11.771513+0000","last_active":"2024-09-10T21:06:13.106695+0000","last_peered":"2024-09-10T21:06:13.106695+0000","last_clean":"2024-09-10T21:06:13.106695+0000","last_became_active":"2024-09-10T21:06:11.771109+0000","last_became_peered":"2024-09-10T21:06:11.771109+0000","last_unstale":"2024-09-10T21:06:13.106695+0000","last_undegraded":"2024-09-10T21:06:13.106695+0000","last_fullsized":"2024-09-10T21:06:13.106695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:52.565604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106557+0000","last_change":"2024-09-10T21:06:07.735827+0000","last_active":"2024-09-10T21:06:13.106557+0000","last_peered":"2024-09-10T21:06:13.106557+0000","last_clean":"2024-09-10T21:06:13.106557+0000","last_became_active":"2024-09-10T21:06:07.735570+0000","last_became_peered":"2024-09-10T21:06:07.735570+0000","last_unstale":"2024-09-10T21:06:13.106557+0000","last_undegraded":"2024-09-10T21:06:13.106557+0000","last_fullsized":"2024-09-10T21:06:13.106557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:26.644366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107030+0000","last_change":"2024-09-10T21:06:06.736508+0000","last_active":"2024-09-10T21:06:13.107030+0000","last_peered":"2024-09-10T21:06:13.107030+0000","last_clean":"2024-09-10T21:06:13.107030+0000","last_became_active":"2024-09-10T21:06:06.733786+0000","last_became_peered":"2024-09-10T21:06:06.733786+0000","last_unstale":"2024-09-10T21:06:13.107030+0000","last_undegraded":"2024-09-10T21:06:13.107030+0000","last_fullsized":"2024-09-10T21:06:13.107030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:20.425789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106109+0000","last_change":"2024-09-10T21:06:11.773388+0000","last_active":"2024-09-10T21:06:13.106109+0000","last_peered":"2024-09-10T21:06:13.106109+0000","last_clean":"2024-09-10T21:06:13.106109+0000","last_became_active":"2024-09-10T21:06:11.773037+0000","last_became_peered":"2024-09-10T21:06:11.773037+0000","last_unstale":"2024-09-10T21:06:13.106109+0000","last_undegraded":"2024-09-10T21:06:13.106109+0000","last_fullsized":"2024-09-10T21:06:13.106109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:19.666141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751686+0000","last_change":"2024-09-10T21:06:07.741169+0000","last_active":"2024-09-10T21:06:12.751686+0000","last_peered":"2024-09-10T21:06:12.751686+0000","last_clean":"2024-09-10T21:06:12.751686+0000","last_became_active":"2024-09-10T21:06:07.732016+0000","last_became_peered":"2024-09-10T21:06:07.732016+0000","last_unstale":"2024-09-10T21:06:12.751686+0000","last_undegraded":"2024-09-10T21:06:12.751686+0000","last_fullsized":"2024-09-10T21:06:12.751686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:31.704899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096056+0000","last_change":"2024-09-10T21:06:06.723528+0000","last_active":"2024-09-10T21:06:13.096056+0000","last_peered":"2024-09-10T21:06:13.096056+0000","last_clean":"2024-09-10T21:06:13.096056+0000","last_became_active":"2024-09-10T21:06:06.723230+0000","last_became_peered":"2024-09-10T21:06:06.723230+0000","last_unstale":"2024-09-10T21:06:13.096056+0000","last_undegraded":"2024-09-10T21:06:13.096056+0000","last_fullsized":"2024-09-10T21:06:13.096056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:38.577023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095831+0000","last_change":"2024-09-10T21:06:11.764290+0000","last_active":"2024-09-10T21:06:13.095831+0000","last_peered":"2024-09-10T21:06:13.095831+0000","last_clean":"2024-09-10T21:06:13.095831+0000","last_became_active":"2024-09-10T21:06:11.763048+0000","last_became_peered":"2024-09-10T21:06:11.763048+0000","last_unstale":"2024-09-10T21:06:13.095831+0000","last_undegraded":"2024-09-10T21:06:13.095831+0000","last_fullsized":"2024-09-10T21:06:13.095831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:16.973732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751824+0000","last_change":"2024-09-10T21:06:07.747804+0000","last_active":"2024-09-10T21:06:12.751824+0000","last_peered":"2024-09-10T21:06:12.751824+0000","last_clean":"2024-09-10T21:06:12.751824+0000","last_became_active":"2024-09-10T21:06:07.747314+0000","last_became_peered":"2024-09-10T21:06:07.747314+0000","last_unstale":"2024-09-10T21:06:12.751824+0000","last_undegraded":"2024-09-10T21:06:12.751824+0000","last_fullsized":"2024-09-10T21:06:12.751824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:12.784568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106675+0000","last_change":"2024-09-10T21:06:06.733973+0000","last_active":"2024-09-10T21:06:13.106675+0000","last_peered":"2024-09-10T21:06:13.106675+0000","last_clean":"2024-09-10T21:06:13.106675+0000","last_became_active":"2024-09-10T21:06:06.733657+0000","last_became_peered":"2024-09-10T21:06:06.733657+0000","last_unstale":"2024-09-10T21:06:13.106675+0000","last_undegraded":"2024-09-10T21:06:13.106675+0000","last_fullsized":"2024-09-10T21:06:13.106675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.848743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105337+0000","last_change":"2024-09-10T21:06:11.772129+0000","last_active":"2024-09-10T21:06:13.105337+0000","last_peered":"2024-09-10T21:06:13.105337+0000","last_clean":"2024-09-10T21:06:13.105337+0000","last_became_active":"2024-09-10T21:06:11.771760+0000","last_became_peered":"2024-09-10T21:06:11.771760+0000","last_unstale":"2024-09-10T21:06:13.105337+0000","last_undegraded":"2024-09-10T21:06:13.105337+0000","last_fullsized":"2024-09-10T21:06:13.105337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:19.126960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107660+0000","last_change":"2024-09-10T21:06:07.740671+0000","last_active":"2024-09-10T21:06:13.107660+0000","last_peered":"2024-09-10T21:06:13.107660+0000","last_clean":"2024-09-10T21:06:13.107660+0000","last_became_active":"2024-09-10T21:06:07.740358+0000","last_became_peered":"2024-09-10T21:06:07.740358+0000","last_unstale":"2024-09-10T21:06:13.107660+0000","last_undegraded":"2024-09-10T21:06:13.107660+0000","last_fullsized":"2024-09-10T21:06:13.107660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:23.671822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751972+0000","last_change":"2024-09-10T21:06:06.733420+0000","last_active":"2024-09-10T21:06:12.751972+0000","last_peered":"2024-09-10T21:06:12.751972+0000","last_clean":"2024-09-10T21:06:12.751972+0000","last_became_active":"2024-09-10T21:06:06.733124+0000","last_became_peered":"2024-09-10T21:06:06.733124+0000","last_unstale":"2024-09-10T21:06:12.751972+0000","last_undegraded":"2024-09-10T21:06:12.751972+0000","last_fullsized":"2024-09-10T21:06:12.751972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.848743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754527+0000","last_change":"2024-09-10T21:06:11.765124+0000","last_active":"2024-09-10T21:06:12.754527+0000","last_peered":"2024-09-10T21:06:12.754527+0000","last_clean":"2024-09-10T21:06:12.754527+0000","last_became_active":"2024-09-10T21:06:11.764737+0000","last_became_peered":"2024-09-10T21:06:11.764737+0000","last_unstale":"2024-09-10T21:06:12.754527+0000","last_undegraded":"2024-09-10T21:06:12.754527+0000","last_fullsized":"2024-09-10T21:06:12.754527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:54.343216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105542+0000","last_change":"2024-09-10T21:06:07.722858+0000","last_active":"2024-09-10T21:06:13.105542+0000","last_peered":"2024-09-10T21:06:13.105542+0000","last_clean":"2024-09-10T21:06:13.105542+0000","last_became_active":"2024-09-10T21:06:07.722606+0000","last_became_peered":"2024-09-10T21:06:07.722606+0000","last_unstale":"2024-09-10T21:06:13.105542+0000","last_undegraded":"2024-09-10T21:06:13.105542+0000","last_fullsized":"2024-09-10T21:06:13.105542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:12.784568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105962+0000","last_change":"2024-09-10T21:06:06.732829+0000","last_active":"2024-09-10T21:06:13.105962+0000","last_peered":"2024-09-10T21:06:13.105962+0000","last_clean":"2024-09-10T21:06:13.105962+0000","last_became_active":"2024-09-10T21:06:06.732330+0000","last_became_peered":"2024-09-10T21:06:06.732330+0000","last_unstale":"2024-09-10T21:06:13.105962+0000","last_undegraded":"2024-09-10T21:06:13.105962+0000","last_fullsized":"2024-09-10T21:06:13.105962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:31.995655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096366+0000","last_change":"2024-09-10T21:06:11.770617+0000","last_active":"2024-09-10T21:06:13.096366+0000","last_peered":"2024-09-10T21:06:13.096366+0000","last_clean":"2024-09-10T21:06:13.096366+0000","last_became_active":"2024-09-10T21:06:11.770181+0000","last_became_peered":"2024-09-10T21:06:11.770181+0000","last_unstale":"2024-09-10T21:06:13.096366+0000","last_undegraded":"2024-09-10T21:06:13.096366+0000","last_fullsized":"2024-09-10T21:06:13.096366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:24.035068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754317+0000","last_change":"2024-09-10T21:06:07.736943+0000","last_active":"2024-09-10T21:06:12.754317+0000","last_peered":"2024-09-10T21:06:12.754317+0000","last_clean":"2024-09-10T21:06:12.754317+0000","last_became_active":"2024-09-10T21:06:07.734718+0000","last_became_peered":"2024-09-10T21:06:07.734718+0000","last_unstale":"2024-09-10T21:06:12.754317+0000","last_undegraded":"2024-09-10T21:06:12.754317+0000","last_fullsized":"2024-09-10T21:06:12.754317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751075+0000","last_change":"2024-09-10T21:06:06.721908+0000","last_active":"2024-09-10T21:06:12.751075+0000","last_peered":"2024-09-10T21:06:12.751075+0000","last_clean":"2024-09-10T21:06:12.751075+0000","last_became_active":"2024-09-10T21:06:06.721632+0000","last_became_peered":"2024-09-10T21:06:06.721632+0000","last_unstale":"2024-09-10T21:06:12.751075+0000","last_undegraded":"2024-09-10T21:06:12.751075+0000","last_fullsized":"2024-09-10T21:06:12.751075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:23.541255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096704+0000","last_change":"2024-09-10T21:06:11.778809+0000","last_active":"2024-09-10T21:06:13.096704+0000","last_peered":"2024-09-10T21:06:13.096704+0000","last_clean":"2024-09-10T21:06:13.096704+0000","last_became_active":"2024-09-10T21:06:11.773850+0000","last_became_peered":"2024-09-10T21:06:11.773850+0000","last_unstale":"2024-09-10T21:06:13.096704+0000","last_undegraded":"2024-09-10T21:06:13.096704+0000","last_fullsized":"2024-09-10T21:06:13.096704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:31.261505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105504+0000","last_change":"2024-09-10T21:06:07.748130+0000","last_active":"2024-09-10T21:06:13.105504+0000","last_peered":"2024-09-10T21:06:13.105504+0000","last_clean":"2024-09-10T21:06:13.105504+0000","last_became_active":"2024-09-10T21:06:07.747878+0000","last_became_peered":"2024-09-10T21:06:07.747878+0000","last_unstale":"2024-09-10T21:06:13.105504+0000","last_undegraded":"2024-09-10T21:06:13.105504+0000","last_fullsized":"2024-09-10T21:06:13.105504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:59.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105808+0000","last_change":"2024-09-10T21:06:06.726018+0000","last_active":"2024-09-10T21:06:13.105808+0000","last_peered":"2024-09-10T21:06:13.105808+0000","last_clean":"2024-09-10T21:06:13.105808+0000","last_became_active":"2024-09-10T21:06:06.725738+0000","last_became_peered":"2024-09-10T21:06:06.725738+0000","last_unstale":"2024-09-10T21:06:13.105808+0000","last_undegraded":"2024-09-10T21:06:13.105808+0000","last_fullsized":"2024-09-10T21:06:13.105808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:56.619842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105827+0000","last_change":"2024-09-10T21:06:11.765453+0000","last_active":"2024-09-10T21:06:13.105827+0000","last_peered":"2024-09-10T21:06:13.105827+0000","last_clean":"2024-09-10T21:06:13.105827+0000","last_became_active":"2024-09-10T21:06:11.764276+0000","last_became_peered":"2024-09-10T21:06:11.764276+0000","last_unstale":"2024-09-10T21:06:13.105827+0000","last_undegraded":"2024-09-10T21:06:13.105827+0000","last_fullsized":"2024-09-10T21:06:13.105827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:05.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106078+0000","last_change":"2024-09-10T21:06:07.735444+0000","last_active":"2024-09-10T21:06:13.106078+0000","last_peered":"2024-09-10T21:06:13.106078+0000","last_clean":"2024-09-10T21:06:13.106078+0000","last_became_active":"2024-09-10T21:06:07.734064+0000","last_became_peered":"2024-09-10T21:06:07.734064+0000","last_unstale":"2024-09-10T21:06:13.106078+0000","last_undegraded":"2024-09-10T21:06:13.106078+0000","last_fullsized":"2024-09-10T21:06:13.106078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:30.575576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755368+0000","last_change":"2024-09-10T21:06:06.735638+0000","last_active":"2024-09-10T21:06:12.755368+0000","last_peered":"2024-09-10T21:06:12.755368+0000","last_clean":"2024-09-10T21:06:12.755368+0000","last_became_active":"2024-09-10T21:06:06.735293+0000","last_became_peered":"2024-09-10T21:06:06.735293+0000","last_unstale":"2024-09-10T21:06:12.755368+0000","last_undegraded":"2024-09-10T21:06:12.755368+0000","last_fullsized":"2024-09-10T21:06:12.755368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:24.628433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106316+0000","last_change":"2024-09-10T21:06:11.764039+0000","last_active":"2024-09-10T21:06:13.106316+0000","last_peered":"2024-09-10T21:06:13.106316+0000","last_clean":"2024-09-10T21:06:13.106316+0000","last_became_active":"2024-09-10T21:06:11.763682+0000","last_became_peered":"2024-09-10T21:06:11.763682+0000","last_unstale":"2024-09-10T21:06:13.106316+0000","last_undegraded":"2024-09-10T21:06:13.106316+0000","last_fullsized":"2024-09-10T21:06:13.106316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:16.839314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751619+0000","last_change":"2024-09-10T21:06:07.738236+0000","last_active":"2024-09-10T21:06:12.751619+0000","last_peered":"2024-09-10T21:06:12.751619+0000","last_clean":"2024-09-10T21:06:12.751619+0000","last_became_active":"2024-09-10T21:06:07.737917+0000","last_became_peered":"2024-09-10T21:06:07.737917+0000","last_unstale":"2024-09-10T21:06:12.751619+0000","last_undegraded":"2024-09-10T21:06:12.751619+0000","last_fullsized":"2024-09-10T21:06:12.751619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:55.077742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:20.089669+0000","last_change":"2024-09-10T21:06:06.731715+0000","last_active":"2024-09-10T21:06:20.089669+0000","last_peered":"2024-09-10T21:06:20.089669+0000","last_clean":"2024-09-10T21:06:20.089669+0000","last_became_active":"2024-09-10T21:06:06.731420+0000","last_became_peered":"2024-09-10T21:06:06.731420+0000","last_unstale":"2024-09-10T21:06:20.089669+0000","last_undegraded":"2024-09-10T21:06:20.089669+0000","last_fullsized":"2024-09-10T21:06:20.089669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:33.538737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106144+0000","last_change":"2024-09-10T21:06:11.762541+0000","last_active":"2024-09-10T21:06:13.106144+0000","last_peered":"2024-09-10T21:06:13.106144+0000","last_clean":"2024-09-10T21:06:13.106144+0000","last_became_active":"2024-09-10T21:06:11.762102+0000","last_became_peered":"2024-09-10T21:06:11.762102+0000","last_unstale":"2024-09-10T21:06:13.106144+0000","last_undegraded":"2024-09-10T21:06:13.106144+0000","last_fullsized":"2024-09-10T21:06:13.106144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:59.114459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106254+0000","last_change":"2024-09-10T21:06:07.724490+0000","last_active":"2024-09-10T21:06:13.106254+0000","last_peered":"2024-09-10T21:06:13.106254+0000","last_clean":"2024-09-10T21:06:13.106254+0000","last_became_active":"2024-09-10T21:06:07.724157+0000","last_became_peered":"2024-09-10T21:06:07.724157+0000","last_unstale":"2024-09-10T21:06:13.106254+0000","last_undegraded":"2024-09-10T21:06:13.106254+0000","last_fullsized":"2024-09-10T21:06:13.106254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:23.477983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755368+0000","last_change":"2024-09-10T21:06:06.739360+0000","last_active":"2024-09-10T21:06:12.755368+0000","last_peered":"2024-09-10T21:06:12.755368+0000","last_clean":"2024-09-10T21:06:12.755368+0000","last_became_active":"2024-09-10T21:06:06.739136+0000","last_became_peered":"2024-09-10T21:06:06.739136+0000","last_unstale":"2024-09-10T21:06:12.755368+0000","last_undegraded":"2024-09-10T21:06:12.755368+0000","last_fullsized":"2024-09-10T21:06:12.755368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:42.131131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106640+0000","last_change":"2024-09-10T21:06:11.775845+0000","last_active":"2024-09-10T21:06:13.106640+0000","last_peered":"2024-09-10T21:06:13.106640+0000","last_clean":"2024-09-10T21:06:13.106640+0000","last_became_active":"2024-09-10T21:06:11.775460+0000","last_became_peered":"2024-09-10T21:06:11.775460+0000","last_unstale":"2024-09-10T21:06:13.106640+0000","last_undegraded":"2024-09-10T21:06:13.106640+0000","last_fullsized":"2024-09-10T21:06:13.106640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:11.820369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096792+0000","last_change":"2024-09-10T21:06:07.732030+0000","last_active":"2024-09-10T21:06:13.096792+0000","last_peered":"2024-09-10T21:06:13.096792+0000","last_clean":"2024-09-10T21:06:13.096792+0000","last_became_active":"2024-09-10T21:06:07.731726+0000","last_became_peered":"2024-09-10T21:06:07.731726+0000","last_unstale":"2024-09-10T21:06:13.096792+0000","last_undegraded":"2024-09-10T21:06:13.096792+0000","last_fullsized":"2024-09-10T21:06:13.096792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:51.701343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751643+0000","last_change":"2024-09-10T21:06:06.724643+0000","last_active":"2024-09-10T21:06:12.751643+0000","last_peered":"2024-09-10T21:06:12.751643+0000","last_clean":"2024-09-10T21:06:12.751643+0000","last_became_active":"2024-09-10T21:06:06.724348+0000","last_became_peered":"2024-09-10T21:06:06.724348+0000","last_unstale":"2024-09-10T21:06:12.751643+0000","last_undegraded":"2024-09-10T21:06:12.751643+0000","last_fullsized":"2024-09-10T21:06:12.751643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:14.047312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754380+0000","last_change":"2024-09-10T21:06:11.772999+0000","last_active":"2024-09-10T21:06:12.754380+0000","last_peered":"2024-09-10T21:06:12.754380+0000","last_clean":"2024-09-10T21:06:12.754380+0000","last_became_active":"2024-09-10T21:06:11.771544+0000","last_became_peered":"2024-09-10T21:06:11.771544+0000","last_unstale":"2024-09-10T21:06:12.754380+0000","last_undegraded":"2024-09-10T21:06:12.754380+0000","last_fullsized":"2024-09-10T21:06:12.754380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:10.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107606+0000","last_change":"2024-09-10T21:06:07.737581+0000","last_active":"2024-09-10T21:06:13.107606+0000","last_peered":"2024-09-10T21:06:13.107606+0000","last_clean":"2024-09-10T21:06:13.107606+0000","last_became_active":"2024-09-10T21:06:07.737246+0000","last_became_peered":"2024-09-10T21:06:07.737246+0000","last_unstale":"2024-09-10T21:06:13.107606+0000","last_undegraded":"2024-09-10T21:06:13.107606+0000","last_fullsized":"2024-09-10T21:06:13.107606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755005+0000","last_change":"2024-09-10T21:06:06.736661+0000","last_active":"2024-09-10T21:06:12.755005+0000","last_peered":"2024-09-10T21:06:12.755005+0000","last_clean":"2024-09-10T21:06:12.755005+0000","last_became_active":"2024-09-10T21:06:06.736356+0000","last_became_peered":"2024-09-10T21:06:06.736356+0000","last_unstale":"2024-09-10T21:06:12.755005+0000","last_undegraded":"2024-09-10T21:06:12.755005+0000","last_fullsized":"2024-09-10T21:06:12.755005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:20.425789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105911+0000","last_change":"2024-09-10T21:06:11.760467+0000","last_active":"2024-09-10T21:06:13.105911+0000","last_peered":"2024-09-10T21:06:13.105911+0000","last_clean":"2024-09-10T21:06:13.105911+0000","last_became_active":"2024-09-10T21:06:11.760101+0000","last_became_peered":"2024-09-10T21:06:11.760101+0000","last_unstale":"2024-09-10T21:06:13.105911+0000","last_undegraded":"2024-09-10T21:06:13.105911+0000","last_fullsized":"2024-09-10T21:06:13.105911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:03.280132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106059+0000","last_change":"2024-09-10T21:06:11.763190+0000","last_active":"2024-09-10T21:06:13.106059+0000","last_peered":"2024-09-10T21:06:13.106059+0000","last_clean":"2024-09-10T21:06:13.106059+0000","last_became_active":"2024-09-10T21:06:11.758968+0000","last_became_peered":"2024-09-10T21:06:11.758968+0000","last_unstale":"2024-09-10T21:06:13.106059+0000","last_undegraded":"2024-09-10T21:06:13.106059+0000","last_fullsized":"2024-09-10T21:06:13.106059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:16.821284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106076+0000","last_change":"2024-09-10T21:06:07.747586+0000","last_active":"2024-09-10T21:06:13.106076+0000","last_peered":"2024-09-10T21:06:13.106076+0000","last_clean":"2024-09-10T21:06:13.106076+0000","last_became_active":"2024-09-10T21:06:07.745029+0000","last_became_peered":"2024-09-10T21:06:07.745029+0000","last_unstale":"2024-09-10T21:06:13.106076+0000","last_undegraded":"2024-09-10T21:06:13.106076+0000","last_fullsized":"2024-09-10T21:06:13.106076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:28.948769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105798+0000","last_change":"2024-09-10T21:06:06.719711+0000","last_active":"2024-09-10T21:06:13.105798+0000","last_peered":"2024-09-10T21:06:13.105798+0000","last_clean":"2024-09-10T21:06:13.105798+0000","last_became_active":"2024-09-10T21:06:06.719461+0000","last_became_peered":"2024-09-10T21:06:06.719461+0000","last_unstale":"2024-09-10T21:06:13.105798+0000","last_undegraded":"2024-09-10T21:06:13.105798+0000","last_fullsized":"2024-09-10T21:06:13.105798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:05.884744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106296+0000","last_change":"2024-09-10T21:06:11.763903+0000","last_active":"2024-09-10T21:06:13.106296+0000","last_peered":"2024-09-10T21:06:13.106296+0000","last_clean":"2024-09-10T21:06:13.106296+0000","last_became_active":"2024-09-10T21:06:11.763549+0000","last_became_peered":"2024-09-10T21:06:11.763549+0000","last_unstale":"2024-09-10T21:06:13.106296+0000","last_undegraded":"2024-09-10T21:06:13.106296+0000","last_fullsized":"2024-09-10T21:06:13.106296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:28.790789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095775+0000","last_change":"2024-09-10T21:06:07.736045+0000","last_active":"2024-09-10T21:06:13.095775+0000","last_peered":"2024-09-10T21:06:13.095775+0000","last_clean":"2024-09-10T21:06:13.095775+0000","last_became_active":"2024-09-10T21:06:07.733458+0000","last_became_peered":"2024-09-10T21:06:07.733458+0000","last_unstale":"2024-09-10T21:06:13.095775+0000","last_undegraded":"2024-09-10T21:06:13.095775+0000","last_fullsized":"2024-09-10T21:06:13.095775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:31.627773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105575+0000","last_change":"2024-09-10T21:06:06.729442+0000","last_active":"2024-09-10T21:06:13.105575+0000","last_peered":"2024-09-10T21:06:13.105575+0000","last_clean":"2024-09-10T21:06:13.105575+0000","last_became_active":"2024-09-10T21:06:06.729045+0000","last_became_peered":"2024-09-10T21:06:06.729045+0000","last_unstale":"2024-09-10T21:06:13.105575+0000","last_undegraded":"2024-09-10T21:06:13.105575+0000","last_fullsized":"2024-09-10T21:06:13.105575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:35.821653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105776+0000","last_change":"2024-09-10T21:06:06.728511+0000","last_active":"2024-09-10T21:06:13.105776+0000","last_peered":"2024-09-10T21:06:13.105776+0000","last_clean":"2024-09-10T21:06:13.105776+0000","last_became_active":"2024-09-10T21:06:06.728200+0000","last_became_peered":"2024-09-10T21:06:06.728200+0000","last_unstale":"2024-09-10T21:06:13.105776+0000","last_undegraded":"2024-09-10T21:06:13.105776+0000","last_fullsized":"2024-09-10T21:06:13.105776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:30.893513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106622+0000","last_change":"2024-09-10T21:06:07.750023+0000","last_active":"2024-09-10T21:06:13.106622+0000","last_peered":"2024-09-10T21:06:13.106622+0000","last_clean":"2024-09-10T21:06:13.106622+0000","last_became_active":"2024-09-10T21:06:07.749735+0000","last_became_peered":"2024-09-10T21:06:07.749735+0000","last_unstale":"2024-09-10T21:06:13.106622+0000","last_undegraded":"2024-09-10T21:06:13.106622+0000","last_fullsized":"2024-09-10T21:06:13.106622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:09.221744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106429+0000","last_change":"2024-09-10T21:06:11.764282+0000","last_active":"2024-09-10T21:06:13.106429+0000","last_peered":"2024-09-10T21:06:13.106429+0000","last_clean":"2024-09-10T21:06:13.106429+0000","last_became_active":"2024-09-10T21:06:11.763052+0000","last_became_peered":"2024-09-10T21:06:11.763052+0000","last_unstale":"2024-09-10T21:06:13.106429+0000","last_undegraded":"2024-09-10T21:06:13.106429+0000","last_fullsized":"2024-09-10T21:06:13.106429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:49.419399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096049+0000","last_change":"2024-09-10T21:06:06.724502+0000","last_active":"2024-09-10T21:06:13.096049+0000","last_peered":"2024-09-10T21:06:13.096049+0000","last_clean":"2024-09-10T21:06:13.096049+0000","last_became_active":"2024-09-10T21:06:06.723257+0000","last_became_peered":"2024-09-10T21:06:06.723257+0000","last_unstale":"2024-09-10T21:06:13.096049+0000","last_undegraded":"2024-09-10T21:06:13.096049+0000","last_fullsized":"2024-09-10T21:06:13.096049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:05.686880+0000","last_clean_scrub_stamp":"2024-09-10T21:06:05.686880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:33.839048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754544+0000","last_change":"2024-09-10T21:06:07.731233+0000","last_active":"2024-09-10T21:06:12.754544+0000","last_peered":"2024-09-10T21:06:12.754544+0000","last_clean":"2024-09-10T21:06:12.754544+0000","last_became_active":"2024-09-10T21:06:07.730548+0000","last_became_peered":"2024-09-10T21:06:07.730548+0000","last_unstale":"2024-09-10T21:06:12.754544+0000","last_undegraded":"2024-09-10T21:06:12.754544+0000","last_fullsized":"2024-09-10T21:06:12.754544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.755250+0000","last_change":"2024-09-10T21:06:11.774785+0000","last_active":"2024-09-10T21:06:12.755250+0000","last_peered":"2024-09-10T21:06:12.755250+0000","last_clean":"2024-09-10T21:06:12.755250+0000","last_became_active":"2024-09-10T21:06:11.774346+0000","last_became_peered":"2024-09-10T21:06:11.774346+0000","last_unstale":"2024-09-10T21:06:12.755250+0000","last_undegraded":"2024-09-10T21:06:12.755250+0000","last_fullsized":"2024-09-10T21:06:12.755250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:10.729246+0000","last_clean_scrub_stamp":"2024-09-10T21:06:10.729246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:02.110289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105230+0000","last_change":"2024-09-10T21:06:07.740108+0000","last_active":"2024-09-10T21:06:13.105230+0000","last_peered":"2024-09-10T21:06:13.105230+0000","last_clean":"2024-09-10T21:06:13.105230+0000","last_became_active":"2024-09-10T21:06:07.739794+0000","last_became_peered":"2024-09-10T21:06:07.739794+0000","last_unstale":"2024-09-10T21:06:13.105230+0000","last_undegraded":"2024-09-10T21:06:13.105230+0000","last_fullsized":"2024-09-10T21:06:13.105230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754458+0000","last_change":"2024-09-10T21:06:07.733770+0000","last_active":"2024-09-10T21:06:12.754458+0000","last_peered":"2024-09-10T21:06:12.754458+0000","last_clean":"2024-09-10T21:06:12.754458+0000","last_became_active":"2024-09-10T21:06:07.733519+0000","last_became_peered":"2024-09-10T21:06:07.733519+0000","last_unstale":"2024-09-10T21:06:12.754458+0000","last_undegraded":"2024-09-10T21:06:12.754458+0000","last_fullsized":"2024-09-10T21:06:12.754458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:57.013181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105599+0000","last_change":"2024-09-10T21:06:07.722573+0000","last_active":"2024-09-10T21:06:13.105599+0000","last_peered":"2024-09-10T21:06:13.105599+0000","last_clean":"2024-09-10T21:06:13.105599+0000","last_became_active":"2024-09-10T21:06:07.722291+0000","last_became_peered":"2024-09-10T21:06:07.722291+0000","last_unstale":"2024-09-10T21:06:13.105599+0000","last_undegraded":"2024-09-10T21:06:13.105599+0000","last_fullsized":"2024-09-10T21:06:13.105599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:24.676940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095949+0000","last_change":"2024-09-10T21:06:07.725057+0000","last_active":"2024-09-10T21:06:13.095949+0000","last_peered":"2024-09-10T21:06:13.095949+0000","last_clean":"2024-09-10T21:06:13.095949+0000","last_became_active":"2024-09-10T21:06:07.724777+0000","last_became_peered":"2024-09-10T21:06:07.724777+0000","last_unstale":"2024-09-10T21:06:13.095949+0000","last_undegraded":"2024-09-10T21:06:13.095949+0000","last_fullsized":"2024-09-10T21:06:13.095949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:05.565224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106908+0000","last_change":"2024-09-10T21:06:07.735771+0000","last_active":"2024-09-10T21:06:13.106908+0000","last_peered":"2024-09-10T21:06:13.106908+0000","last_clean":"2024-09-10T21:06:13.106908+0000","last_became_active":"2024-09-10T21:06:07.735447+0000","last_became_peered":"2024-09-10T21:06:07.735447+0000","last_unstale":"2024-09-10T21:06:13.106908+0000","last_undegraded":"2024-09-10T21:06:13.106908+0000","last_fullsized":"2024-09-10T21:06:13.106908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:21.629321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107117+0000","last_change":"2024-09-10T21:06:07.726407+0000","last_active":"2024-09-10T21:06:13.107117+0000","last_peered":"2024-09-10T21:06:13.107117+0000","last_clean":"2024-09-10T21:06:13.107117+0000","last_became_active":"2024-09-10T21:06:07.726061+0000","last_became_peered":"2024-09-10T21:06:07.726061+0000","last_unstale":"2024-09-10T21:06:13.107117+0000","last_undegraded":"2024-09-10T21:06:13.107117+0000","last_fullsized":"2024-09-10T21:06:13.107117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:23.671822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107518+0000","last_change":"2024-09-10T21:06:07.737552+0000","last_active":"2024-09-10T21:06:13.107518+0000","last_peered":"2024-09-10T21:06:13.107518+0000","last_clean":"2024-09-10T21:06:13.107518+0000","last_became_active":"2024-09-10T21:06:07.737253+0000","last_became_peered":"2024-09-10T21:06:07.737253+0000","last_unstale":"2024-09-10T21:06:13.107518+0000","last_undegraded":"2024-09-10T21:06:13.107518+0000","last_fullsized":"2024-09-10T21:06:13.107518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:43.241906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096602+0000","last_change":"2024-09-10T21:06:07.738429+0000","last_active":"2024-09-10T21:06:13.096602+0000","last_peered":"2024-09-10T21:06:13.096602+0000","last_clean":"2024-09-10T21:06:13.096602+0000","last_became_active":"2024-09-10T21:06:07.736750+0000","last_became_peered":"2024-09-10T21:06:07.736750+0000","last_unstale":"2024-09-10T21:06:13.096602+0000","last_undegraded":"2024-09-10T21:06:13.096602+0000","last_fullsized":"2024-09-10T21:06:13.096602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:15.172285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105703+0000","last_change":"2024-09-10T21:06:07.727750+0000","last_active":"2024-09-10T21:06:13.105703+0000","last_peered":"2024-09-10T21:06:13.105703+0000","last_clean":"2024-09-10T21:06:13.105703+0000","last_became_active":"2024-09-10T21:06:07.727492+0000","last_became_peered":"2024-09-10T21:06:07.727492+0000","last_unstale":"2024-09-10T21:06:13.105703+0000","last_undegraded":"2024-09-10T21:06:13.105703+0000","last_fullsized":"2024-09-10T21:06:13.105703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:45.382683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095636+0000","last_change":"2024-09-10T21:06:07.734497+0000","last_active":"2024-09-10T21:06:13.095636+0000","last_peered":"2024-09-10T21:06:13.095636+0000","last_clean":"2024-09-10T21:06:13.095636+0000","last_became_active":"2024-09-10T21:06:07.731837+0000","last_became_peered":"2024-09-10T21:06:07.731837+0000","last_unstale":"2024-09-10T21:06:13.095636+0000","last_undegraded":"2024-09-10T21:06:13.095636+0000","last_fullsized":"2024-09-10T21:06:13.095636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:10.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754456+0000","last_change":"2024-09-10T21:06:07.731385+0000","last_active":"2024-09-10T21:06:12.754456+0000","last_peered":"2024-09-10T21:06:12.754456+0000","last_clean":"2024-09-10T21:06:12.754456+0000","last_became_active":"2024-09-10T21:06:07.730952+0000","last_became_peered":"2024-09-10T21:06:07.730952+0000","last_unstale":"2024-09-10T21:06:12.754456+0000","last_undegraded":"2024-09-10T21:06:12.754456+0000","last_fullsized":"2024-09-10T21:06:12.754456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106509+0000","last_change":"2024-09-10T21:06:07.743829+0000","last_active":"2024-09-10T21:06:13.106509+0000","last_peered":"2024-09-10T21:06:13.106509+0000","last_clean":"2024-09-10T21:06:13.106509+0000","last_became_active":"2024-09-10T21:06:07.743556+0000","last_became_peered":"2024-09-10T21:06:07.743556+0000","last_unstale":"2024-09-10T21:06:13.106509+0000","last_undegraded":"2024-09-10T21:06:13.106509+0000","last_fullsized":"2024-09-10T21:06:13.106509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:31:58.073572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751609+0000","last_change":"2024-09-10T21:06:07.731428+0000","last_active":"2024-09-10T21:06:12.751609+0000","last_peered":"2024-09-10T21:06:12.751609+0000","last_clean":"2024-09-10T21:06:12.751609+0000","last_became_active":"2024-09-10T21:06:07.731151+0000","last_became_peered":"2024-09-10T21:06:07.731151+0000","last_unstale":"2024-09-10T21:06:12.751609+0000","last_undegraded":"2024-09-10T21:06:12.751609+0000","last_fullsized":"2024-09-10T21:06:12.751609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:10.318478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106834+0000","last_change":"2024-09-10T21:06:07.729264+0000","last_active":"2024-09-10T21:06:13.106834+0000","last_peered":"2024-09-10T21:06:13.106834+0000","last_clean":"2024-09-10T21:06:13.106834+0000","last_became_active":"2024-09-10T21:06:07.729001+0000","last_became_peered":"2024-09-10T21:06:07.729001+0000","last_unstale":"2024-09-10T21:06:13.106834+0000","last_undegraded":"2024-09-10T21:06:13.106834+0000","last_fullsized":"2024-09-10T21:06:13.106834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:13.030165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754965+0000","last_change":"2024-09-10T21:06:07.729035+0000","last_active":"2024-09-10T21:06:12.754965+0000","last_peered":"2024-09-10T21:06:12.754965+0000","last_clean":"2024-09-10T21:06:12.754965+0000","last_became_active":"2024-09-10T21:06:07.728726+0000","last_became_peered":"2024-09-10T21:06:07.728726+0000","last_unstale":"2024-09-10T21:06:12.754965+0000","last_undegraded":"2024-09-10T21:06:12.754965+0000","last_fullsized":"2024-09-10T21:06:12.754965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:36.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.107040+0000","last_change":"2024-09-10T21:06:07.727552+0000","last_active":"2024-09-10T21:06:13.107040+0000","last_peered":"2024-09-10T21:06:13.107040+0000","last_clean":"2024-09-10T21:06:13.107040+0000","last_became_active":"2024-09-10T21:06:07.727247+0000","last_became_peered":"2024-09-10T21:06:07.727247+0000","last_unstale":"2024-09-10T21:06:13.107040+0000","last_undegraded":"2024-09-10T21:06:13.107040+0000","last_fullsized":"2024-09-10T21:06:13.107040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:17.742182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105603+0000","last_change":"2024-09-10T21:06:07.724043+0000","last_active":"2024-09-10T21:06:13.105603+0000","last_peered":"2024-09-10T21:06:13.105603+0000","last_clean":"2024-09-10T21:06:13.105603+0000","last_became_active":"2024-09-10T21:06:07.723760+0000","last_became_peered":"2024-09-10T21:06:07.723760+0000","last_unstale":"2024-09-10T21:06:13.105603+0000","last_undegraded":"2024-09-10T21:06:13.105603+0000","last_fullsized":"2024-09-10T21:06:13.105603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:31.704899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095465+0000","last_change":"2024-09-10T21:06:07.731993+0000","last_active":"2024-09-10T21:06:13.095465+0000","last_peered":"2024-09-10T21:06:13.095465+0000","last_clean":"2024-09-10T21:06:13.095465+0000","last_became_active":"2024-09-10T21:06:07.728201+0000","last_became_peered":"2024-09-10T21:06:07.728201+0000","last_unstale":"2024-09-10T21:06:13.095465+0000","last_undegraded":"2024-09-10T21:06:13.095465+0000","last_fullsized":"2024-09-10T21:06:13.095465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:37.030681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.105964+0000","last_change":"2024-09-10T21:06:07.726441+0000","last_active":"2024-09-10T21:06:13.105964+0000","last_peered":"2024-09-10T21:06:13.105964+0000","last_clean":"2024-09-10T21:06:13.105964+0000","last_became_active":"2024-09-10T21:06:07.726129+0000","last_became_peered":"2024-09-10T21:06:07.726129+0000","last_unstale":"2024-09-10T21:06:13.105964+0000","last_undegraded":"2024-09-10T21:06:13.105964+0000","last_fullsized":"2024-09-10T21:06:13.105964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:50.280191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106522+0000","last_change":"2024-09-10T21:06:07.745674+0000","last_active":"2024-09-10T21:06:13.106522+0000","last_peered":"2024-09-10T21:06:13.106522+0000","last_clean":"2024-09-10T21:06:13.106522+0000","last_became_active":"2024-09-10T21:06:07.745377+0000","last_became_peered":"2024-09-10T21:06:07.745377+0000","last_unstale":"2024-09-10T21:06:13.106522+0000","last_undegraded":"2024-09-10T21:06:13.106522+0000","last_fullsized":"2024-09-10T21:06:13.106522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:58.465613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751580+0000","last_change":"2024-09-10T21:06:07.742353+0000","last_active":"2024-09-10T21:06:12.751580+0000","last_peered":"2024-09-10T21:06:12.751580+0000","last_clean":"2024-09-10T21:06:12.751580+0000","last_became_active":"2024-09-10T21:06:07.741768+0000","last_became_peered":"2024-09-10T21:06:07.741768+0000","last_unstale":"2024-09-10T21:06:12.751580+0000","last_undegraded":"2024-09-10T21:06:12.751580+0000","last_fullsized":"2024-09-10T21:06:12.751580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:46:21.303563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751664+0000","last_change":"2024-09-10T21:06:07.750182+0000","last_active":"2024-09-10T21:06:12.751664+0000","last_peered":"2024-09-10T21:06:12.751664+0000","last_clean":"2024-09-10T21:06:12.751664+0000","last_became_active":"2024-09-10T21:06:07.749545+0000","last_became_peered":"2024-09-10T21:06:07.749545+0000","last_unstale":"2024-09-10T21:06:12.751664+0000","last_undegraded":"2024-09-10T21:06:12.751664+0000","last_fullsized":"2024-09-10T21:06:12.751664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:40:01.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751610+0000","last_change":"2024-09-10T21:06:07.744262+0000","last_active":"2024-09-10T21:06:12.751610+0000","last_peered":"2024-09-10T21:06:12.751610+0000","last_clean":"2024-09-10T21:06:12.751610+0000","last_became_active":"2024-09-10T21:06:07.732781+0000","last_became_peered":"2024-09-10T21:06:07.732781+0000","last_unstale":"2024-09-10T21:06:12.751610+0000","last_undegraded":"2024-09-10T21:06:12.751610+0000","last_fullsized":"2024-09-10T21:06:12.751610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:58.650133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.754980+0000","last_change":"2024-09-10T21:06:07.733975+0000","last_active":"2024-09-10T21:06:12.754980+0000","last_peered":"2024-09-10T21:06:12.754980+0000","last_clean":"2024-09-10T21:06:12.754980+0000","last_became_active":"2024-09-10T21:06:07.733715+0000","last_became_peered":"2024-09-10T21:06:07.733715+0000","last_unstale":"2024-09-10T21:06:12.754980+0000","last_undegraded":"2024-09-10T21:06:12.754980+0000","last_fullsized":"2024-09-10T21:06:12.754980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:31.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095474+0000","last_change":"2024-09-10T21:06:07.739522+0000","last_active":"2024-09-10T21:06:13.095474+0000","last_peered":"2024-09-10T21:06:13.095474+0000","last_clean":"2024-09-10T21:06:13.095474+0000","last_became_active":"2024-09-10T21:06:07.739162+0000","last_became_peered":"2024-09-10T21:06:07.739162+0000","last_unstale":"2024-09-10T21:06:13.095474+0000","last_undegraded":"2024-09-10T21:06:13.095474+0000","last_fullsized":"2024-09-10T21:06:13.095474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:03.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751051+0000","last_change":"2024-09-10T21:06:07.728083+0000","last_active":"2024-09-10T21:06:12.751051+0000","last_peered":"2024-09-10T21:06:12.751051+0000","last_clean":"2024-09-10T21:06:12.751051+0000","last_became_active":"2024-09-10T21:06:07.727804+0000","last_became_peered":"2024-09-10T21:06:07.727804+0000","last_unstale":"2024-09-10T21:06:12.751051+0000","last_undegraded":"2024-09-10T21:06:12.751051+0000","last_fullsized":"2024-09-10T21:06:12.751051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:19:04.725083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106825+0000","last_change":"2024-09-10T21:06:07.741270+0000","last_active":"2024-09-10T21:06:13.106825+0000","last_peered":"2024-09-10T21:06:13.106825+0000","last_clean":"2024-09-10T21:06:13.106825+0000","last_became_active":"2024-09-10T21:06:07.740584+0000","last_became_peered":"2024-09-10T21:06:07.740584+0000","last_unstale":"2024-09-10T21:06:13.106825+0000","last_undegraded":"2024-09-10T21:06:13.106825+0000","last_fullsized":"2024-09-10T21:06:13.106825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:52.489450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751331+0000","last_change":"2024-09-10T21:06:07.745169+0000","last_active":"2024-09-10T21:06:12.751331+0000","last_peered":"2024-09-10T21:06:12.751331+0000","last_clean":"2024-09-10T21:06:12.751331+0000","last_became_active":"2024-09-10T21:06:07.744772+0000","last_became_peered":"2024-09-10T21:06:07.744772+0000","last_unstale":"2024-09-10T21:06:12.751331+0000","last_undegraded":"2024-09-10T21:06:12.751331+0000","last_fullsized":"2024-09-10T21:06:12.751331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:03.406166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.106982+0000","last_change":"2024-09-10T21:06:07.736065+0000","last_active":"2024-09-10T21:06:13.106982+0000","last_peered":"2024-09-10T21:06:13.106982+0000","last_clean":"2024-09-10T21:06:13.106982+0000","last_became_active":"2024-09-10T21:06:07.735732+0000","last_became_peered":"2024-09-10T21:06:07.735732+0000","last_unstale":"2024-09-10T21:06:13.106982+0000","last_undegraded":"2024-09-10T21:06:13.106982+0000","last_fullsized":"2024-09-10T21:06:13.106982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:57.625491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.095910+0000","last_change":"2024-09-10T21:06:07.739765+0000","last_active":"2024-09-10T21:06:13.095910+0000","last_peered":"2024-09-10T21:06:13.095910+0000","last_clean":"2024-09-10T21:06:13.095910+0000","last_became_active":"2024-09-10T21:06:07.739457+0000","last_became_peered":"2024-09-10T21:06:07.739457+0000","last_unstale":"2024-09-10T21:06:13.095910+0000","last_undegraded":"2024-09-10T21:06:13.095910+0000","last_fullsized":"2024-09-10T21:06:13.095910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:58.818281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:13.096192+0000","last_change":"2024-09-10T21:06:07.735873+0000","last_active":"2024-09-10T21:06:13.096192+0000","last_peered":"2024-09-10T21:06:13.096192+0000","last_clean":"2024-09-10T21:06:13.096192+0000","last_became_active":"2024-09-10T21:06:07.735589+0000","last_became_peered":"2024-09-10T21:06:07.735589+0000","last_unstale":"2024-09-10T21:06:13.096192+0000","last_undegraded":"2024-09-10T21:06:13.096192+0000","last_fullsized":"2024-09-10T21:06:13.096192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:26.970429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T21:06:12.751832+0000","last_change":"2024-09-10T21:06:07.748933+0000","last_active":"2024-09-10T21:06:12.751832+0000","last_peered":"2024-09-10T21:06:12.751832+0000","last_clean":"2024-09-10T21:06:12.751832+0000","last_became_active":"2024-09-10T21:06:07.748659+0000","last_became_peered":"2024-09-10T21:06:07.748659+0000","last_unstale":"2024-09-10T21:06:12.751832+0000","last_undegraded":"2024-09-10T21:06:12.751832+0000","last_fullsized":"2024-09-10T21:06:12.751832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:06:06.692529+0000","last_clean_scrub_stamp":"2024-09-10T21:06:06.692529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:26.789804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":110565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":880640,"data_stored":701003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:06:30.645 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T21:06:30.645 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T21:06:30.645 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T21:06:30.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T21:06:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.835+0000 7f72eb200640 1 -- 172.21.15.100:0/1255569408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e4161ef0 msgr2=0x7f72e406dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.835+0000 7f72eb200640 1 --2- 172.21.15.100:0/1255569408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e4161ef0 0x7f72e406dc60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f72d0005fd0 tx=0x7f72d002a5d0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.835+0000 7f72eb200640 1 -- 172.21.15.100:0/1255569408 shutdown_connections 2024-09-10T21:06:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.835+0000 7f72eb200640 1 --2- 172.21.15.100:0/1255569408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e4161ef0 0x7f72e406dc60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.835+0000 7f72eb200640 1 --2- 172.21.15.100:0/1255569408 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e41612a0 0x7f72e41619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.835+0000 7f72eb200640 1 -- 172.21.15.100:0/1255569408 >> 172.21.15.100:0/1255569408 conn(0x7f72e40d1a10 msgr2=0x7f72e40d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.835+0000 7f72eb200640 1 -- 172.21.15.100:0/1255569408 shutdown_connections 2024-09-10T21:06:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.835+0000 7f72eb200640 1 -- 172.21.15.100:0/1255569408 wait complete. 2024-09-10T21:06:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.836+0000 7f72eb200640 1 Processor -- start 2024-09-10T21:06:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.836+0000 7f72eb200640 1 -- start start 2024-09-10T21:06:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.837+0000 7f72eb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e406e1a0 0x7f72e40b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.837+0000 7f72eb200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e41612a0 0x7f72e40c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.837+0000 7f72eb200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e4161ef0 0x7f72e40c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.837+0000 7f72eb200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72e406ee80 con 0x7f72e406e1a0 2024-09-10T21:06:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.837+0000 7f72eb200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72e406ed00 con 0x7f72e4161ef0 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.837+0000 7f72eb200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f72e406f000 con 0x7f72e41612a0 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.837+0000 7f72e3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e406e1a0 0x7f72e40b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e406e1a0 0x7f72e40b6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35280/0 (socket says 172.21.15.100:35280) 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3e00640 1 -- 172.21.15.100:0/3776153697 learned_addr learned my addr 172.21.15.100:0/3776153697 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3400640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e41612a0 0x7f72e40c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e9200640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e4161ef0 0x7f72e40c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3e00640 1 -- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e41612a0 msgr2=0x7f72e40c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3e00640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e41612a0 0x7f72e40c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3e00640 1 -- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e4161ef0 msgr2=0x7f72e40c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3e00640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e4161ef0 0x7f72e40c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3e00640 1 -- 172.21.15.100:0/3776153697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e40c55e0 con 0x7f72e406e1a0 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e9200640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e4161ef0 0x7f72e40c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72e3e00640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e406e1a0 0x7f72e40b6e70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72d400eab0 tx=0x7f72d400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.838+0000 7f72dbe00640 1 -- 172.21.15.100:0/3776153697 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d400cde0 con 0x7f72e406e1a0 2024-09-10T21:06:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.839+0000 7f72dbe00640 1 -- 172.21.15.100:0/3776153697 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72d4011560 con 0x7f72e406e1a0 2024-09-10T21:06:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.839+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e40c58c0 con 0x7f72e406e1a0 2024-09-10T21:06:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.839+0000 7f72dbe00640 1 -- 172.21.15.100:0/3776153697 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4011950 con 0x7f72e406e1a0 2024-09-10T21:06:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.839+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e41f5810 con 0x7f72e406e1a0 2024-09-10T21:06:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.840+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e40b28f0 con 0x7f72e406e1a0 2024-09-10T21:06:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.841+0000 7f72dbe00640 1 -- 172.21.15.100:0/3776153697 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f72d4022030 con 0x7f72e406e1a0 2024-09-10T21:06:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.842+0000 7f72dbe00640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f72c4077fa0 0x7f72c407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.842+0000 7f72dbe00640 1 -- 172.21.15.100:0/3776153697 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f72d409a970 con 0x7f72e406e1a0 2024-09-10T21:06:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.843+0000 7f72e3400640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f72c4077fa0 0x7f72c407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.843+0000 7f72e3400640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f72c4077fa0 0x7f72c407a460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72d0033000 tx=0x7f72d0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:30.846+0000 7f72dbe00640 1 -- 172.21.15.100:0/3776153697 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f72d4016030 con 0x7f72e406e1a0 2024-09-10T21:06:31.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.066+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f72e415e890 con 0x7f72e406e1a0 2024-09-10T21:06:31.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.066+0000 7f72dbe00640 1 -- 172.21.15.100:0/3776153697 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f72d40631c0 con 0x7f72e406e1a0 2024-09-10T21:06:31.071 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:31.071 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f72c4077fa0 msgr2=0x7f72c407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f72c4077fa0 0x7f72c407a460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72d0033000 tx=0x7f72d0004730 comp rx=0 tx=0).stop 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e406e1a0 msgr2=0x7f72e40b6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e406e1a0 0x7f72e40b6e70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72d400eab0 tx=0x7f72d400ef70 comp rx=0 tx=0).stop 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 shutdown_connections 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f72c4077fa0 0x7f72c407a460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e4161ef0 0x7f72e40c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72e41612a0 0x7f72e40c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 --2- 172.21.15.100:0/3776153697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e406e1a0 0x7f72e40b6e70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 >> 172.21.15.100:0/3776153697 conn(0x7f72e40d1a10 msgr2=0x7f72e40716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 shutdown_connections 2024-09-10T21:06:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.069+0000 7f72eb200640 1 -- 172.21.15.100:0/3776153697 wait complete. 2024-09-10T21:06:31.090 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T21:06:31.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:31.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.242+0000 7f786ec00640 1 -- 172.21.15.100:0/444794377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f786815b680 msgr2=0x7f786815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.242+0000 7f786ec00640 1 --2- 172.21.15.100:0/444794377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f786815b680 0x7f786815ba60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7858005fd0 tx=0x7f785802aaa0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.242+0000 7f786ec00640 1 -- 172.21.15.100:0/444794377 shutdown_connections 2024-09-10T21:06:31.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.242+0000 7f786ec00640 1 --2- 172.21.15.100:0/444794377 >> v2:172.21.15.130:3300/0 conn(0x7f78680741e0 0x7f786815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.242+0000 7f786ec00640 1 --2- 172.21.15.100:0/444794377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f786815b680 0x7f786815ba60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.242+0000 7f786ec00640 1 -- 172.21.15.100:0/444794377 >> 172.21.15.100:0/444794377 conn(0x7f786806cb50 msgr2=0x7f786806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:31.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.242+0000 7f786ec00640 1 -- 172.21.15.100:0/444794377 shutdown_connections 2024-09-10T21:06:31.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.242+0000 7f786ec00640 1 -- 172.21.15.100:0/444794377 wait complete. 2024-09-10T21:06:31.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.244+0000 7f786ec00640 1 Processor -- start 2024-09-10T21:06:31.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.244+0000 7f786ec00640 1 -- start start 2024-09-10T21:06:31.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.245+0000 7f786ec00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78680741e0 0x7f78681543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:31.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.245+0000 7f786ec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f786815b680 0x7f78681f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:31.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.245+0000 7f786ec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f786815c750 0x7f78681f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:31.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.245+0000 7f786ec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f78680b29e0 con 0x7f786815c750 2024-09-10T21:06:31.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.245+0000 7f786ec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f78680b2860 con 0x7f786815b680 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.245+0000 7f786ec00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f78680b2b60 con 0x7f78680741e0 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.245+0000 7f786cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f786815c750 0x7f78681f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f786cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f786815c750 0x7f78681f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35296/0 (socket says 172.21.15.100:35296) 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f786cc00640 1 -- 172.21.15.100:0/449992842 learned_addr learned my addr 172.21.15.100:0/449992842 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f7867e00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78680741e0 0x7f78681543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f7867400640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f786815b680 0x7f78681f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f786cc00640 1 -- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78680741e0 msgr2=0x7f78681543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f786cc00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78680741e0 0x7f78681543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f786cc00640 1 -- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f786815b680 msgr2=0x7f78681f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f786cc00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f786815b680 0x7f78681f7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f786cc00640 1 -- 172.21.15.100:0/449992842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7868154910 con 0x7f786815c750 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f786cc00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f786815c750 0x7f78681f4cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7860001eb0 tx=0x7f786000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.246+0000 7f785fe00640 1 -- 172.21.15.100:0/449992842 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860017070 con 0x7f786815c750 2024-09-10T21:06:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.247+0000 7f785fe00640 1 -- 172.21.15.100:0/449992842 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78600053e0 con 0x7f786815c750 2024-09-10T21:06:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.247+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78681f82e0 con 0x7f786815c750 2024-09-10T21:06:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.247+0000 7f785fe00640 1 -- 172.21.15.100:0/449992842 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860003850 con 0x7f786815c750 2024-09-10T21:06:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.247+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78681f88a0 con 0x7f786815c750 2024-09-10T21:06:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.248+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78681f49c0 con 0x7f786815c750 2024-09-10T21:06:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.249+0000 7f785fe00640 1 -- 172.21.15.100:0/449992842 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f78600039f0 con 0x7f786815c750 2024-09-10T21:06:31.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.250+0000 7f785fe00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7848077f70 0x7f784807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:31.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.250+0000 7f785fe00640 1 -- 172.21.15.100:0/449992842 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f78600995e0 con 0x7f786815c750 2024-09-10T21:06:31.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.250+0000 7f7867e00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7848077f70 0x7f784807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.251+0000 7f7867e00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7848077f70 0x7f784807a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7858035000 tx=0x7f7858039040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.254+0000 7f785fe00640 1 -- 172.21.15.100:0/449992842 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7868154910 con 0x7f786815c750 2024-09-10T21:06:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.469+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78680b3010 con 0x7f786815c750 2024-09-10T21:06:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.469+0000 7f785fe00640 1 -- 172.21.15.100:0/449992842 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f7860061740 con 0x7f786815c750 2024-09-10T21:06:31.474 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:31.474 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-10T21:06:23:611303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:23.012445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-10T21:06:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.471+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7848077f70 msgr2=0x7f784807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.471+0000 7f786ec00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7848077f70 0x7f784807a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7858035000 tx=0x7f7858039040 comp rx=0 tx=0).stop 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.471+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f786815c750 msgr2=0x7f78681f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.471+0000 7f786ec00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f786815c750 0x7f78681f4cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7860001eb0 tx=0x7f786000c820 comp rx=0 tx=0).stop 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.472+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 shutdown_connections 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.472+0000 7f786ec00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f786815c750 0x7f78681f4cd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.472+0000 7f786ec00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7848077f70 0x7f784807a430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.472+0000 7f786ec00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f786815b680 0x7f78681f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.472+0000 7f786ec00640 1 --2- 172.21.15.100:0/449992842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78680741e0 0x7f78681543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.472+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 >> 172.21.15.100:0/449992842 conn(0x7f786806cb50 msgr2=0x7f78680cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.472+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 shutdown_connections 2024-09-10T21:06:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.472+0000 7f786ec00640 1 -- 172.21.15.100:0/449992842 wait complete. 2024-09-10T21:06:31.492 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:31.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.644+0000 7f4fffe00640 1 -- 172.21.15.100:0/2852828644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff80741e0 msgr2=0x7f4ff815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.644+0000 7f4fffe00640 1 --2- 172.21.15.100:0/2852828644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff80741e0 0x7f4ff815f4d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4005fd0 tx=0x7f4fe402a670 comp rx=0 tx=0).stop 2024-09-10T21:06:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.644+0000 7f4fffe00640 1 -- 172.21.15.100:0/2852828644 shutdown_connections 2024-09-10T21:06:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.644+0000 7f4fffe00640 1 --2- 172.21.15.100:0/2852828644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff80741e0 0x7f4ff815f4d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.644+0000 7f4fffe00640 1 -- 172.21.15.100:0/2852828644 >> 172.21.15.100:0/2852828644 conn(0x7f4ff806cb50 msgr2=0x7f4ff806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.644+0000 7f4fffe00640 1 -- 172.21.15.100:0/2852828644 shutdown_connections 2024-09-10T21:06:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.644+0000 7f4fffe00640 1 -- 172.21.15.100:0/2852828644 wait complete. 2024-09-10T21:06:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.646+0000 7f4fffe00640 1 Processor -- start 2024-09-10T21:06:31.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.646+0000 7f4fffe00640 1 -- start start 2024-09-10T21:06:31.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4fffe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ff80741e0 0x7f4ff80aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:31.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4fffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff815b680 0x7f4ff81f8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:31.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4fffe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff815c750 0x7f4ff814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:31.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4fffe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80b2bf0 con 0x7f4ff815b680 2024-09-10T21:06:31.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4fffe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80b2a70 con 0x7f4ff815c750 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4fffe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff80b2d70 con 0x7f4ff80741e0 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4ffca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff815b680 0x7f4ff81f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4ffca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff815b680 0x7f4ff81f8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35316/0 (socket says 172.21.15.100:35316) 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4ffca00640 1 -- 172.21.15.100:0/2444620740 learned_addr learned my addr 172.21.15.100:0/2444620740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.647+0000 7f4ffd400640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ff80741e0 0x7f4ff80aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ffde00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff815c750 0x7f4ff814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ffca00640 1 -- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ff80741e0 msgr2=0x7f4ff80aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ffca00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ff80741e0 0x7f4ff80aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ffca00640 1 -- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff815c750 msgr2=0x7f4ff814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ffca00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff815c750 0x7f4ff814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ffca00640 1 -- 172.21.15.100:0/2444620740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff81f4480 con 0x7f4ff815b680 2024-09-10T21:06:31.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ffca00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff815b680 0x7f4ff81f8170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009850 tx=0x7f4fe40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:31.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ff5600640 1 -- 172.21.15.100:0/2444620740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe403f070 con 0x7f4ff815b680 2024-09-10T21:06:31.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ff5600640 1 -- 172.21.15.100:0/2444620740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fe4004890 con 0x7f4ff815b680 2024-09-10T21:06:31.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff81f4760 con 0x7f4ff815b680 2024-09-10T21:06:31.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.648+0000 7f4ff5600640 1 -- 172.21.15.100:0/2444620740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4035030 con 0x7f4ff815b680 2024-09-10T21:06:31.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.649+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff81f40f0 con 0x7f4ff815b680 2024-09-10T21:06:31.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.650+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff815f4d0 con 0x7f4ff815b680 2024-09-10T21:06:31.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.651+0000 7f4ff5600640 1 -- 172.21.15.100:0/2444620740 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4fe4004c60 con 0x7f4ff815b680 2024-09-10T21:06:31.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.652+0000 7f4ff5600640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fd8077f70 0x7f4fd807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:31.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.652+0000 7f4ff5600640 1 -- 172.21.15.100:0/2444620740 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4fe40bb170 con 0x7f4ff815b680 2024-09-10T21:06:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.652+0000 7f4ffd400640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fd8077f70 0x7f4fd807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.653+0000 7f4ffd400640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fd8077f70 0x7f4fd807a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0012e0 tx=0x7f4fec009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:31.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.656+0000 7f4ff5600640 1 -- 172.21.15.100:0/2444620740 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4fe4083370 con 0x7f4ff815b680 2024-09-10T21:06:31.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.885+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ff80cc490 con 0x7f4ff815b680 2024-09-10T21:06:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.885+0000 7f4ff5600640 1 -- 172.21.15.100:0/2444620740 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f4fe4087da0 con 0x7f4ff815b680 2024-09-10T21:06:31.890 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:31.890 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-10T21:06:23:611303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:23.012445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:31.890 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fd8077f70 msgr2=0x7f4fd807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fd8077f70 0x7f4fd807a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0012e0 tx=0x7f4fec009040 comp rx=0 tx=0).stop 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff815b680 msgr2=0x7f4ff81f8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff815b680 0x7f4ff81f8170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009850 tx=0x7f4fe40039e0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 shutdown_connections 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4fd8077f70 0x7f4fd807a430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff815c750 0x7f4ff814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ff815b680 0x7f4ff81f8170 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 --2- 172.21.15.100:0/2444620740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ff80741e0 0x7f4ff80aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 >> 172.21.15.100:0/2444620740 conn(0x7f4ff806cb50 msgr2=0x7f4ff815d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 shutdown_connections 2024-09-10T21:06:31.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:31.888+0000 7f4fffe00640 1 -- 172.21.15.100:0/2444620740 wait complete. 2024-09-10T21:06:31.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:31.997 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:06:32.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:06:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.064+0000 7fdd9ae00640 1 -- 172.21.15.100:0/297318906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd940d25d0 msgr2=0x7fdd9406d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.064+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/297318906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd940d25d0 0x7fdd9406d060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c005fd0 tx=0x7fdd8c02aa10 comp rx=0 tx=0).stop 2024-09-10T21:06:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.064+0000 7fdd9ae00640 1 -- 172.21.15.100:0/297318906 shutdown_connections 2024-09-10T21:06:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.064+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/297318906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd940d25d0 0x7fdd9406d060 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.064+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/297318906 >> v2:172.21.15.130:3300/0 conn(0x7fdd9406e0a0 0x7fdd940d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.064+0000 7fdd9ae00640 1 -- 172.21.15.100:0/297318906 >> 172.21.15.100:0/297318906 conn(0x7fdd940d3ab0 msgr2=0x7fdd940d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.064+0000 7fdd9ae00640 1 -- 172.21.15.100:0/297318906 shutdown_connections 2024-09-10T21:06:32.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.064+0000 7fdd9ae00640 1 -- 172.21.15.100:0/297318906 wait complete. 2024-09-10T21:06:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.065+0000 7fdd9ae00640 1 Processor -- start 2024-09-10T21:06:32.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.066+0000 7fdd9ae00640 1 -- start start 2024-09-10T21:06:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.066+0000 7fdd9ae00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd9406e0a0 0x7fdd940cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.066+0000 7fdd9ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd94161140 0x7fdd941571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.066+0000 7fdd9ae00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd941f76f0 0x7fdd940b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd9ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9406e8f0 con 0x7fdd94161140 2024-09-10T21:06:32.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd9ae00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9406e770 con 0x7fdd9406e0a0 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd9ae00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdd940b3030 con 0x7fdd941f76f0 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd9406e0a0 0x7fdd940cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd94161140 0x7fdd941571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd9406e0a0 0x7fdd940cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:49890/0 (socket says 172.21.15.100:49890) 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99a00640 1 -- 172.21.15.100:0/2591479287 learned_addr learned my addr 172.21.15.100:0/2591479287 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd9a400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd941f76f0 0x7fdd940b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99000640 1 -- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd941f76f0 msgr2=0x7fdd940b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99000640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd941f76f0 0x7fdd940b8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99000640 1 -- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd9406e0a0 msgr2=0x7fdd940cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99000640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd9406e0a0 0x7fdd940cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99000640 1 -- 172.21.15.100:0/2591479287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd940cbb70 con 0x7fdd94161140 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.067+0000 7fdd99000640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd94161140 0x7fdd941571a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000ea20 tx=0x7fdd8000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.068+0000 7fdd91600640 1 -- 172.21.15.100:0/2591479287 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000cc60 con 0x7fdd94161140 2024-09-10T21:06:32.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.068+0000 7fdd91600640 1 -- 172.21.15.100:0/2591479287 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd80010430 con 0x7fdd94161140 2024-09-10T21:06:32.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.068+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd940cbe50 con 0x7fdd94161140 2024-09-10T21:06:32.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.068+0000 7fdd91600640 1 -- 172.21.15.100:0/2591479287 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80010840 con 0x7fdd94161140 2024-09-10T21:06:32.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.068+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd940c8e10 con 0x7fdd94161140 2024-09-10T21:06:32.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.069+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd9406d760 con 0x7fdd94161140 2024-09-10T21:06:32.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.070+0000 7fdd91600640 1 -- 172.21.15.100:0/2591479287 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdd800109e0 con 0x7fdd94161140 2024-09-10T21:06:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.072+0000 7fdd91600640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fdd74077fa0 0x7fdd7407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.072+0000 7fdd91600640 1 -- 172.21.15.100:0/2591479287 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdd8009aac0 con 0x7fdd94161140 2024-09-10T21:06:32.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.072+0000 7fdd99a00640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fdd74077fa0 0x7fdd7407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:32.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.073+0000 7fdd99a00640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fdd74077fa0 0x7fdd7407a460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd880017e0 tx=0x7fdd88009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:32.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.076+0000 7fdd91600640 1 -- 172.21.15.100:0/2591479287 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdd80062b90 con 0x7fdd94161140 2024-09-10T21:06:32.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.260+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd940b6190 con 0x7fdd94161140 2024-09-10T21:06:32.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.261+0000 7fdd91600640 1 -- 172.21.15.100:0/2591479287 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18626 (secure 0 0 0) 0x7fdd800675c0 con 0x7fdd94161140 2024-09-10T21:06:32.266 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:32.266 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:12.166819+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fdd74077fa0 msgr2=0x7fdd7407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fdd74077fa0 0x7fdd7407a460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd880017e0 tx=0x7fdd88009040 comp rx=0 tx=0).stop 2024-09-10T21:06:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd94161140 msgr2=0x7fdd941571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd94161140 0x7fdd941571a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000ea20 tx=0x7fdd8000eee0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 shutdown_connections 2024-09-10T21:06:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd941f76f0 0x7fdd940b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd94161140 0x7fdd941571a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fdd74077fa0 0x7fdd7407a460 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 --2- 172.21.15.100:0/2591479287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd9406e0a0 0x7fdd940cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 >> 172.21.15.100:0/2591479287 conn(0x7fdd940d3ab0 msgr2=0x7fdd940b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 shutdown_connections 2024-09-10T21:06:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.263+0000 7fdd9ae00640 1 -- 172.21.15.100:0/2591479287 wait complete. 2024-09-10T21:06:32.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:32.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.441+0000 7f7b96c00640 1 -- 172.21.15.100:0/3029200175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b78003ac0 msgr2=0x7f7b78003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.441+0000 7f7b96c00640 1 --2- 172.21.15.100:0/3029200175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b78003ac0 0x7f7b78003ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009b90 tx=0x7f7b78005830 comp rx=0 tx=0).stop 2024-09-10T21:06:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.441+0000 7f7b96200640 1 -- 172.21.15.100:0/3029200175 reap_dead start 2024-09-10T21:06:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.441+0000 7f7b96c00640 1 -- 172.21.15.100:0/3029200175 shutdown_connections 2024-09-10T21:06:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.441+0000 7f7b96c00640 1 -- 172.21.15.100:0/3029200175 >> 172.21.15.100:0/3029200175 conn(0x7f7b900d3ab0 msgr2=0x7f7b900d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.442+0000 7f7b96c00640 1 -- 172.21.15.100:0/3029200175 shutdown_connections 2024-09-10T21:06:32.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.442+0000 7f7b96c00640 1 -- 172.21.15.100:0/3029200175 wait complete. 2024-09-10T21:06:32.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.443+0000 7f7b96c00640 1 Processor -- start 2024-09-10T21:06:32.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.443+0000 7f7b96c00640 1 -- start start 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b96c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b78003ac0 0x7f7b900cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b96c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9015a480 0x7f7b901586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b96c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b900ce590 0x7f7b900cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b96c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7b901616a0 con 0x7f7b9015a480 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b96c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90161520 con 0x7f7b78003ac0 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b96c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7b9006e770 con 0x7f7b900ce590 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b94e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9015a480 0x7f7b901586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b94e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9015a480 0x7f7b901586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37352/0 (socket says 172.21.15.100:37352) 2024-09-10T21:06:32.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.444+0000 7f7b94e00640 1 -- 172.21.15.100:0/4203291370 learned_addr learned my addr 172.21.15.100:0/4203291370 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b95800640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b78003ac0 0x7f7b900cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b96200640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b900ce590 0x7f7b900cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b94e00640 1 -- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b900ce590 msgr2=0x7f7b900cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b94e00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b900ce590 0x7f7b900cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b94e00640 1 -- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b78003ac0 msgr2=0x7f7b900cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b94e00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b78003ac0 0x7f7b900cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b94e00640 1 -- 172.21.15.100:0/4203291370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b90159070 con 0x7f7b9015a480 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b95800640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b78003ac0 0x7f7b900cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b96200640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b900ce590 0x7f7b900cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b94e00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9015a480 0x7f7b901586b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0063d0 tx=0x7f7b7c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b8d600640 1 -- 172.21.15.100:0/4203291370 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c015070 con 0x7f7b9015a480 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b8d600640 1 -- 172.21.15.100:0/4203291370 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b7c011860 con 0x7f7b9015a480 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b8d600640 1 -- 172.21.15.100:0/4203291370 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c011cb0 con 0x7f7b9015a480 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.445+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b90159350 con 0x7f7b9015a480 2024-09-10T21:06:32.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.446+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b90159910 con 0x7f7b9015a480 2024-09-10T21:06:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.447+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b900b31a0 con 0x7f7b9015a480 2024-09-10T21:06:32.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.448+0000 7f7b8d600640 1 -- 172.21.15.100:0/4203291370 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7b7c0103c0 con 0x7f7b9015a480 2024-09-10T21:06:32.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.449+0000 7f7b8d600640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7b70077f70 0x7f7b7007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:32.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.449+0000 7f7b8d600640 1 -- 172.21.15.100:0/4203291370 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7b7c09b100 con 0x7f7b9015a480 2024-09-10T21:06:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.449+0000 7f7b95800640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7b70077f70 0x7f7b7007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:32.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.450+0000 7f7b95800640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7b70077f70 0x7f7b7007a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009b90 tx=0x7f7b8402d040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:32.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.453+0000 7f7b8d600640 1 -- 172.21.15.100:0/4203291370 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7b7c063830 con 0x7f7b9015a480 2024-09-10T21:06:32.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.680+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b9015f610 con 0x7f7b9015a480 2024-09-10T21:06:32.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.681+0000 7f7b8d600640 1 -- 172.21.15.100:0/4203291370 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f7b7c063130 con 0x7f7b9015a480 2024-09-10T21:06:32.686 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:32.686 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-10T21:06:23:611303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:23.012445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:32.686 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-10T21:06:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7b70077f70 msgr2=0x7f7b7007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7b70077f70 0x7f7b7007a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009b90 tx=0x7f7b8402d040 comp rx=0 tx=0).stop 2024-09-10T21:06:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9015a480 msgr2=0x7f7b901586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9015a480 0x7f7b901586b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0063d0 tx=0x7f7b7c0039c0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 shutdown_connections 2024-09-10T21:06:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b900ce590 0x7f7b900cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b9015a480 0x7f7b901586b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7b70077f70 0x7f7b7007a430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 --2- 172.21.15.100:0/4203291370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b78003ac0 0x7f7b900cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.683+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 >> 172.21.15.100:0/4203291370 conn(0x7f7b900d3ab0 msgr2=0x7f7b900d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.684+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 shutdown_connections 2024-09-10T21:06:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:32.684+0000 7f7b96c00640 1 -- 172.21.15.100:0/4203291370 wait complete. 2024-09-10T21:06:33.107 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T21:06:07.129552+0000', 'modified': '2024-09-10T21:06:23.012445+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4401}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4401': {'gid': 4401, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6837/2407425318', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6835', 'nonce': 2407425318}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 2407425318}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4401, 'qdb_cluster': [4401]} 2024-09-10T21:06:33.107 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T21:06:33.107 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T21:06:33.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 -- 172.21.15.100:0/2336552365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 msgr2=0x7f631c0ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 --2- 172.21.15.100:0/2336552365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 0x7f631c0ae490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f631c06e0e0 tx=0x7f631402a980 comp rx=0 tx=0).stop 2024-09-10T21:06:33.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 -- 172.21.15.100:0/2336552365 shutdown_connections 2024-09-10T21:06:33.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 --2- 172.21.15.100:0/2336552365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 0x7f631c0ae490 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 --2- 172.21.15.100:0/2336552365 >> v2:172.21.15.130:3300/0 conn(0x7f631c15c6c0 0x7f631c073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 --2- 172.21.15.100:0/2336552365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f631c155df0 0x7f631c0730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 -- 172.21.15.100:0/2336552365 >> 172.21.15.100:0/2336552365 conn(0x7f631c0b1480 msgr2=0x7f631c0b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:33.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 -- 172.21.15.100:0/2336552365 shutdown_connections 2024-09-10T21:06:33.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.266+0000 7f631be00640 1 -- 172.21.15.100:0/2336552365 wait complete. 2024-09-10T21:06:33.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.268+0000 7f631be00640 1 Processor -- start 2024-09-10T21:06:33.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.268+0000 7f631be00640 1 -- start start 2024-09-10T21:06:33.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 0x7f631c0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f631c155df0 0x7f631c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631be00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f631c15c6c0 0x7f631c153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f631c0cbed0 con 0x7f631c0740b0 2024-09-10T21:06:33.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631be00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f631c0cbd50 con 0x7f631c155df0 2024-09-10T21:06:33.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631be00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f631c0ae9d0 con 0x7f631c15c6c0 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 0x7f631c0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 0x7f631c0c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37376/0 (socket says 172.21.15.100:37376) 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631aa00640 1 -- 172.21.15.100:0/531098586 learned_addr learned my addr 172.21.15.100:0/531098586 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631a000640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f631c155df0 0x7f631c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.269+0000 7f631b400640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f631c15c6c0 0x7f631c153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f631aa00640 1 -- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f631c15c6c0 msgr2=0x7f631c153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f631aa00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f631c15c6c0 0x7f631c153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f631aa00640 1 -- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f631c155df0 msgr2=0x7f631c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f631aa00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f631c155df0 0x7f631c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f631aa00640 1 -- 172.21.15.100:0/531098586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631c1540e0 con 0x7f631c0740b0 2024-09-10T21:06:33.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f631aa00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 0x7f631c0c5e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f630c00d770 tx=0x7f630c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:33.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f6312a00640 1 -- 172.21.15.100:0/531098586 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c017070 con 0x7f631c0740b0 2024-09-10T21:06:33.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f6312a00640 1 -- 172.21.15.100:0/531098586 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f630c009d20 con 0x7f631c0740b0 2024-09-10T21:06:33.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f631be00640 1 -- 172.21.15.100:0/531098586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631c0c4d70 con 0x7f631c0740b0 2024-09-10T21:06:33.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.270+0000 7f6312a00640 1 -- 172.21.15.100:0/531098586 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0106c0 con 0x7f631c0740b0 2024-09-10T21:06:33.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.271+0000 7f631be00640 1 -- 172.21.15.100:0/531098586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f631c0c5330 con 0x7f631c0740b0 2024-09-10T21:06:33.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.273+0000 7f6312a00640 1 -- 172.21.15.100:0/531098586 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f630c010860 con 0x7f631c0740b0 2024-09-10T21:06:33.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.274+0000 7f6312a00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f62fc077f70 0x7f62fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.275+0000 7f6312a00640 1 -- 172.21.15.100:0/531098586 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f630c09a4f0 con 0x7f631c0740b0 2024-09-10T21:06:33.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.275+0000 7f6324676740 1 Processor -- start 2024-09-10T21:06:33.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.275+0000 7f631a000640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f62fc077f70 0x7f62fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.275+0000 7f6324676740 1 -- start start 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f631a000640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f62fc077f70 0x7f62fc07a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f631c154d20 tx=0x7f630800b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f6324676740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfae7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f6324676740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 0x5582cfae6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f6324676740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f6324676740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5582cfa25430 con 0x5582cfae7aa0 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f6324676740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5582cfa155d0 con 0x5582cfaa3190 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f6324676740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5582cfa04a00 con 0x5582cfaa2c10 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f631aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfae7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f631aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfae7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37392/0 (socket says 172.21.15.100:37392) 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f631aa00640 1 -- 172.21.15.100:0/2446235076 learned_addr learned my addr 172.21.15.100:0/2446235076 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f631a000640 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 0x5582cfae6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.276+0000 7f631b400640 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f631aa00640 1 -- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 msgr2=0x5582cfae6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:33.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f631aa00640 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 0x5582cfae6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f631aa00640 1 -- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 msgr2=0x5582cfae6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:33.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f631aa00640 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f631aa00640 1 -- 172.21.15.100:0/2446235076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582cf9cd520 con 0x5582cfae7aa0 2024-09-10T21:06:33.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f631b400640 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f631aa00640 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfae7e80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f630c098640 tx=0x7f630c00de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97f01e39cb1035f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f6307000640 1 -- 172.21.15.100:0/2446235076 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c021030 con 0x5582cfae7aa0 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f6307000640 1 -- 172.21.15.100:0/2446235076 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f630c0620e0 con 0x5582cfae7aa0 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.277+0000 7f6307000640 1 -- 172.21.15.100:0/2446235076 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0625d0 con 0x5582cfae7aa0 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 -- 172.21.15.100:0/2446235076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 msgr2=0x5582cfae7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfae7e80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f630c098640 tx=0x7f630c00de80 comp rx=0 tx=0).stop 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 -- 172.21.15.100:0/2446235076 shutdown_connections 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 0x5582cfae6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 --2- 172.21.15.100:0/2446235076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfae7e80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 -- 172.21.15.100:0/2446235076 >> 172.21.15.100:0/2446235076 conn(0x5582cfa9e1e0 msgr2=0x5582cfaa1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 -- 172.21.15.100:0/2446235076 shutdown_connections 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.278+0000 7f6324676740 1 -- 172.21.15.100:0/2446235076 wait complete. 2024-09-10T21:06:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.279+0000 7f6324676740 1 -- start start 2024-09-10T21:06:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.279+0000 7f6324676740 1 Processor -- start 2024-09-10T21:06:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f6324676740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f6324676740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfafa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f6324676740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfafa6f0 0x5582cfae6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f6324676740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5582cf9ab330 con 0x5582cfae7aa0 2024-09-10T21:06:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f6324676740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5582cfa08810 con 0x5582cfaa3190 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f6324676740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5582cf775620 con 0x5582cfafa6f0 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f6324676740 10 client.0 _ll_register_callbacks cb 0x5582cf9b0420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f631a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfafa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f631a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfafa1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37408/0 (socket says 172.21.15.100:37408) 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f631a000640 1 -- 172.21.15.100:0/2549701072 learned_addr learned my addr 172.21.15.100:0/2549701072 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f631aa00640 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f631b400640 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfafa6f0 0x5582cfae6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f631a000640 1 -- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfafa6f0 msgr2=0x5582cfae6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.280+0000 7f631a000640 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfafa6f0 0x5582cfae6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f631a000640 1 -- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 msgr2=0x5582cfae1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f631a000640 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f631a000640 1 -- 172.21.15.100:0/2549701072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582cf766850 con 0x5582cfae7aa0 2024-09-10T21:06:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f631aa00640 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f631a000640 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfafa1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f63080116f0 tx=0x7f6308004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e723e9a833934f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f62fb400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f62fb400640 1 -- 172.21.15.100:0/2549701072 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630801f900 con 0x5582cfae7aa0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f62fb400640 1 -- 172.21.15.100:0/2549701072 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f630801faa0 con 0x5582cfae7aa0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f6324676740 1 -- 172.21.15.100:0/2549701072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f630c0620e0 con 0x5582cfae7aa0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f62fb400640 1 -- 172.21.15.100:0/2549701072 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f630801fca0 con 0x5582cfae7aa0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f6324676740 10 client.4788 fetch_fsmap learned FSMap version 9 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.281+0000 7f6324676740 1 -- 172.21.15.100:0/2549701072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5582cf7dd6b0 con 0x5582cfae7aa0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f62fb400640 1 -- 172.21.15.100:0/2549701072 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f630c0620e0 con 0x5582cfae7aa0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f62fb400640 1 -- 172.21.15.100:0/2549701072 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f6308030050 con 0x5582cfae7aa0 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f6324676740 10 client.4788 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f6324676740 10 client.4788 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:06:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f6324676740 20 client.4788 populate_metadata read hostname 'smithi100' 2024-09-10T21:06:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f6324676740 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x5582cfacbdb0 0x5582cfaf87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f6324676740 4 client.4788 mds_command: new command op to 4401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:06:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f6324676740 1 -- 172.21.15.100:0/2549701072 --> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582cfa17520 con 0x5582cfacbdb0 2024-09-10T21:06:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.282+0000 7f631aa00640 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x5582cfacbdb0 0x5582cfaf87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.283+0000 7f631aa00640 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x5582cfacbdb0 0x5582cfaf87d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6e6c4a8555988f3 server_cookie=5e4b49e0c892e55c in_seq=0 out_seq=0 2024-09-10T21:06:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.283+0000 7f62fb400640 10 client.4788 ms_handle_connect on v2:172.21.15.130:6835/2407425318 2024-09-10T21:06:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.283+0000 7f62fb400640 1 -- 172.21.15.100:0/2549701072 <== mds.0 v2:172.21.15.130:6835/2407425318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582cfa17520 con 0x5582cfacbdb0 2024-09-10T21:06:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.283+0000 7f62fb400640 10 client.4788 handle_command_reply: tid=0 2024-09-10T21:06:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 client.4788 shutdown 2024-09-10T21:06:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 -- 172.21.15.100:0/2549701072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 msgr2=0x5582cfafa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfafa1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f63080116f0 tx=0x7f6308004730 comp rx=0 tx=0).stop 2024-09-10T21:06:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 -- 172.21.15.100:0/2549701072 shutdown_connections 2024-09-10T21:06:33.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x5582cfacbdb0 0x5582cfaf87d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfafa6f0 0x5582cfae6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f62fb400640 0 client.4788 ms_handle_reset on v2:172.21.15.130:6835/2407425318 2024-09-10T21:06:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfae7aa0 0x5582cfafa1b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 --2- 172.21.15.100:0/2549701072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfaa3190 0x5582cfae1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 -- 172.21.15.100:0/2549701072 >> 172.21.15.100:0/2549701072 conn(0x5582cfaa2c10 msgr2=0x5582cfa9cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 -- 172.21.15.100:0/2549701072 shutdown_connections 2024-09-10T21:06:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 1 -- 172.21.15.100:0/2549701072 wait complete. 2024-09-10T21:06:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.284+0000 7f6324676740 20 client.4788 trim_cache size 0 max 16384 2024-09-10T21:06:33.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.303+0000 7f6324676740 1 Processor -- start 2024-09-10T21:06:33.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.303+0000 7f6324676740 1 -- start start 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f6324676740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa2c10 0x5582cfb0ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f6324676740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa3190 0x5582cfae1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f6324676740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfa9cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f6324676740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f631c201310 con 0x5582cfaa2c10 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f6324676740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f631c200670 con 0x5582cfae7aa0 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f6324676740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f631c200cc0 con 0x5582cfaa3190 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa2c10 0x5582cfb0ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa2c10 0x5582cfb0ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37416/0 (socket says 172.21.15.100:37416) 2024-09-10T21:06:33.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631aa00640 1 -- 172.21.15.100:0/3742560727 learned_addr learned my addr 172.21.15.100:0/3742560727 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631b400640 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfa9cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631aa00640 1 -- 172.21.15.100:0/3742560727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa3190 msgr2=0x5582cfae1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631aa00640 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa3190 0x5582cfae1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631aa00640 1 -- 172.21.15.100:0/3742560727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 msgr2=0x5582cfa9cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631aa00640 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfa9cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631aa00640 1 -- 172.21.15.100:0/3742560727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582cfae9340 con 0x5582cfaa2c10 2024-09-10T21:06:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.304+0000 7f631b400640 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfa9cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:33.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.305+0000 7f631aa00640 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa2c10 0x5582cfb0ac20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f630c05f840 tx=0x7f630c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b857897794a8ad52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.305+0000 7f6306600640 1 -- 172.21.15.100:0/3742560727 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c021040 con 0x5582cfaa2c10 2024-09-10T21:06:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.305+0000 7f6306600640 1 -- 172.21.15.100:0/3742560727 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f630c06ba20 con 0x5582cfaa2c10 2024-09-10T21:06:33.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.305+0000 7f6306600640 1 -- 172.21.15.100:0/3742560727 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0625d0 con 0x5582cfaa2c10 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.305+0000 7f6324676740 1 -- 172.21.15.100:0/3742560727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa2c10 msgr2=0x5582cfb0ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.305+0000 7f6324676740 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa2c10 0x5582cfb0ac20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f630c05f840 tx=0x7f630c009f90 comp rx=0 tx=0).stop 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 -- 172.21.15.100:0/3742560727 shutdown_connections 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfa9cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa3190 0x5582cfae1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 --2- 172.21.15.100:0/3742560727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa2c10 0x5582cfb0ac20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 -- 172.21.15.100:0/3742560727 >> 172.21.15.100:0/3742560727 conn(0x5582cfaa1230 msgr2=0x5582cfaf87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 -- 172.21.15.100:0/3742560727 shutdown_connections 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 -- 172.21.15.100:0/3742560727 wait complete. 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 -- start start 2024-09-10T21:06:33.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.306+0000 7f6324676740 1 Processor -- start 2024-09-10T21:06:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.307+0000 7f6324676740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 0x5582cfade1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.307+0000 7f6324676740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa3190 0x5582cfac6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.307+0000 7f6324676740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfb4d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.307+0000 7f6324676740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5582cfacbc30 con 0x5582cfaa3190 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.307+0000 7f6324676740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5582cfaf91d0 con 0x5582cfae7aa0 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.307+0000 7f6324676740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5582cfacc1c0 con 0x5582cfaa2c10 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.307+0000 7f6324676740 10 client.0 _ll_register_callbacks cb 0x7f6308010d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa3190 0x5582cfac6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa3190 0x5582cfac6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37424/0 (socket says 172.21.15.100:37424) 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 -- 172.21.15.100:0/3109775689 learned_addr learned my addr 172.21.15.100:0/3109775689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631aa00640 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 0x5582cfade1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631b400640 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfb4d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 -- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 msgr2=0x5582cfade1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 0x5582cfade1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 -- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 msgr2=0x5582cfb4d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfb4d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 -- 172.21.15.100:0/3109775689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582cfaf4fb0 con 0x5582cfaa3190 2024-09-10T21:06:33.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f631a000640 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa3190 0x5582cfac6ed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6308010830 tx=0x7f6308010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a0a762c018647b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f62fb400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f62fb400640 1 -- 172.21.15.100:0/3109775689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308037030 con 0x5582cfaa3190 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.308+0000 7f62fb400640 1 -- 172.21.15.100:0/3109775689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f63080329b0 con 0x5582cfaa3190 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 1 -- 172.21.15.100:0/3109775689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f630c06ba20 con 0x5582cfaa3190 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f62fb400640 1 -- 172.21.15.100:0/3109775689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f6308040050 con 0x5582cfaa3190 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 10 client.4794 fetch_fsmap learned FSMap version 9 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 1 -- 172.21.15.100:0/3109775689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5582cfa9b2e0 con 0x5582cfaa3190 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f62fb400640 1 -- 172.21.15.100:0/3109775689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f630c06ba20 con 0x5582cfaa3190 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f62fb400640 1 -- 172.21.15.100:0/3109775689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f6308043020 con 0x5582cfaa3190 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 10 client.4794 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 10 client.4794 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 20 client.4794 populate_metadata read hostname 'smithi100' 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x5582cfafa6f0 0x5582cfb6bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:33.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 4 client.4794 mds_command: new command op to 4401 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f6324676740 1 -- 172.21.15.100:0/3109775689 --> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] -- command(tid 0: {"prefix": "status"}) -- 0x5582cfa12fd0 con 0x5582cfafa6f0 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.309+0000 7f631aa00640 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x5582cfafa6f0 0x5582cfb6bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f631aa00640 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x5582cfafa6f0 0x5582cfb6bd40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b52530dc64c3bc3d server_cookie=7bfaebcabd32d119 in_seq=0 out_seq=0 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f62fb400640 10 client.4794 ms_handle_connect on v2:172.21.15.130:6835/2407425318 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f62fb400640 1 -- 172.21.15.100:0/3109775689 <== mds.0 v2:172.21.15.130:6835/2407425318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5582cfa12fd0 con 0x5582cfafa6f0 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f62fb400640 10 client.4794 handle_command_reply: tid=0 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f6324676740 1 client.4794 shutdown 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f6324676740 1 -- 172.21.15.100:0/3109775689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa3190 msgr2=0x5582cfac6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f6324676740 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa3190 0x5582cfac6ed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6308010830 tx=0x7f6308010b40 comp rx=0 tx=0).stop 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f6324676740 1 -- 172.21.15.100:0/3109775689 shutdown_connections 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.310+0000 7f6324676740 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:6835/2407425318,v1:172.21.15.130:6837/2407425318] conn(0x5582cfafa6f0 0x5582cfb6bd40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f6324676740 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582cfae7aa0 0x5582cfb4d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f6324676740 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582cfaa3190 0x5582cfac6ed0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f6324676740 1 --2- 172.21.15.100:0/3109775689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5582cfaa2c10 0x5582cfade1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f62fb400640 0 client.4794 ms_handle_reset on v2:172.21.15.130:6835/2407425318 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f6324676740 1 -- 172.21.15.100:0/3109775689 >> 172.21.15.100:0/3109775689 conn(0x5582cfaa1230 msgr2=0x5582cfaf8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f6324676740 1 -- 172.21.15.100:0/3109775689 shutdown_connections 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f6324676740 1 -- 172.21.15.100:0/3109775689 wait complete. 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f6324676740 20 client.4794 trim_cache size 0 max 16384 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "65dcb08a-1e46-42c5-ba37-fc802a6ee031", 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4401, 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-10T21:06:33.319 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-10T21:06:33.320 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 25.605981034999999, 2024-09-10T21:06:33.320 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 9, 2024-09-10T21:06:33.320 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 27, 2024-09-10T21:06:33.320 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 27, 2024-09-10T21:06:33.320 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 31.616959721000001 2024-09-10T21:06:33.320 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f631be00640 1 -- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f62fc077f70 msgr2=0x7f62fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f631be00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f62fc077f70 0x7f62fc07a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f631c154d20 tx=0x7f630800b2e0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f631be00640 1 -- 172.21.15.100:0/531098586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 msgr2=0x7f631c0c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.311+0000 7f631be00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 0x7f631c0c5e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f630c00d770 tx=0x7f630c00dc30 comp rx=0 tx=0).stop 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.312+0000 7f631be00640 1 -- 172.21.15.100:0/531098586 shutdown_connections 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.312+0000 7f631be00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f631c15c6c0 0x7f631c153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.312+0000 7f631be00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f62fc077f70 0x7f62fc07a430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.312+0000 7f631be00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f631c155df0 0x7f631c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.312+0000 7f631be00640 1 --2- 172.21.15.100:0/531098586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f631c0740b0 0x7f631c0c5e10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.312+0000 7f631be00640 1 -- 172.21.15.100:0/531098586 >> 172.21.15.100:0/531098586 conn(0x7f631c0b1480 msgr2=0x7f631c159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:33.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.312+0000 7f631be00640 1 -- 172.21.15.100:0/531098586 shutdown_connections 2024-09-10T21:06:33.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:33.312+0000 7f631be00640 1 -- 172.21.15.100:0/531098586 wait complete. 2024-09-10T21:06:33.331 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T21:06:33.341 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T21:06:33.342 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T21:06:33.342 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-10T21:06:33.342 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T21:06:33.342 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:33.342 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-10T21:06:33.342 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T21:06:33.342 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T21:06:33.342 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-10T21:06:33.342 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T21:06:33.343 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:33.343 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-10T21:06:33.343 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T21:06:33.343 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T21:06:33.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:33.343 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T21:06:33.381 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-10T21:06:33.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:33.382 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T21:06:33.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:33.481 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-10T21:06:33.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:33.773 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-09-10T21:06:33.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:33.813 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-09-10T21:06:33.918 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2024-09-10T21:06:33.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:06:33.921 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T21:06:33.921 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T21:06:33.921 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T21:06:34.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.075+0000 7f25a1e00640 1 -- 172.21.15.100:0/3996909203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c06eb60 msgr2=0x7f259c06efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:34.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.075+0000 7f25a1e00640 1 --2- 172.21.15.100:0/3996909203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c06eb60 0x7f259c06efd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2594009860 tx=0x7f259402a670 comp rx=0 tx=0).stop 2024-09-10T21:06:34.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.076+0000 7f25a1e00640 1 -- 172.21.15.100:0/3996909203 shutdown_connections 2024-09-10T21:06:34.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.076+0000 7f25a1e00640 1 --2- 172.21.15.100:0/3996909203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c06eb60 0x7f259c06efd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:34.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.076+0000 7f25a1e00640 1 -- 172.21.15.100:0/3996909203 >> 172.21.15.100:0/3996909203 conn(0x7f259c06cb50 msgr2=0x7f259c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:34.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.076+0000 7f25a1e00640 1 -- 172.21.15.100:0/3996909203 shutdown_connections 2024-09-10T21:06:34.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.076+0000 7f25a1e00640 1 -- 172.21.15.100:0/3996909203 wait complete. 2024-09-10T21:06:34.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.077+0000 7f25a1e00640 1 Processor -- start 2024-09-10T21:06:34.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.077+0000 7f25a1e00640 1 -- start start 2024-09-10T21:06:34.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.078+0000 7f25a1e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f259c06eb60 0x7f259c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:34.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.078+0000 7f25a1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c0cf810 0x7f259c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:34.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.078+0000 7f25a1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259c15b4d0 0x7f259c149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:34.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.078+0000 7f25a1e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f259c0b3010 con 0x7f259c15b4d0 2024-09-10T21:06:34.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.078+0000 7f25a1e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f259c0b2e90 con 0x7f259c0cf810 2024-09-10T21:06:34.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.078+0000 7f25a1e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f259c0b3190 con 0x7f259c06eb60 2024-09-10T21:06:34.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c0cf810 0x7f259c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:34.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259c15b4d0 0x7f259c149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:34.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259c15b4d0 0x7f259c149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37436/0 (socket says 172.21.15.100:37436) 2024-09-10T21:06:34.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c0cf810 0x7f259c158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:49994/0 (socket says 172.21.15.100:49994) 2024-09-10T21:06:34.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259b400640 1 -- 172.21.15.100:0/878633173 learned_addr learned my addr 172.21.15.100:0/878633173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:34.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259aa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f259c06eb60 0x7f259c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:34.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259a000640 1 -- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f259c06eb60 msgr2=0x7f259c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:34.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259a000640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f259c06eb60 0x7f259c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:34.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259a000640 1 -- 172.21.15.100:0/878633173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259c15b4d0 msgr2=0x7f259c149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:34.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259a000640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259c15b4d0 0x7f259c149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:34.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259a000640 1 -- 172.21.15.100:0/878633173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259c1f4e10 con 0x7f259c0cf810 2024-09-10T21:06:34.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259b400640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259c15b4d0 0x7f259c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:34.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.079+0000 7f259a000640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c0cf810 0x7f259c158d30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f258800c370 tx=0x7f258800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:34.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.080+0000 7f2593400640 1 -- 172.21.15.100:0/878633173 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588011790 con 0x7f259c0cf810 2024-09-10T21:06:34.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.080+0000 7f2593400640 1 -- 172.21.15.100:0/878633173 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2588017070 con 0x7f259c0cf810 2024-09-10T21:06:34.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.080+0000 7f2593400640 1 -- 172.21.15.100:0/878633173 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588011d00 con 0x7f259c0cf810 2024-09-10T21:06:34.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.080+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259c0b04f0 con 0x7f259c0cf810 2024-09-10T21:06:34.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.080+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f259c0b0ab0 con 0x7f259c0cf810 2024-09-10T21:06:34.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.081+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259c0b0cb0 con 0x7f259c0cf810 2024-09-10T21:06:34.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.082+0000 7f2593400640 1 -- 172.21.15.100:0/878633173 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f258801c460 con 0x7f259c0cf810 2024-09-10T21:06:34.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.083+0000 7f2593400640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f257c077f70 0x7f257c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:34.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.083+0000 7f2593400640 1 -- 172.21.15.100:0/878633173 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2588099d60 con 0x7f259c0cf810 2024-09-10T21:06:34.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.083+0000 7f259aa00640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f257c077f70 0x7f257c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:34.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.084+0000 7f259aa00640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f257c077f70 0x7f257c07a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f258c000f80 tx=0x7f258c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:34.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.088+0000 7f2593400640 1 -- 172.21.15.100:0/878633173 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f259c0b0cb0 con 0x7f259c0cf810 2024-09-10T21:06:34.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.305+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f259c15aad0 con 0x7f259c0cf810 2024-09-10T21:06:34.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.306+0000 7f2593400640 1 -- 172.21.15.100:0/878633173 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f2588061e30 con 0x7f259c0cf810 2024-09-10T21:06:34.310 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T21:06:34.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f257c077f70 msgr2=0x7f257c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:34.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f257c077f70 0x7f257c07a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f258c000f80 tx=0x7f258c009040 comp rx=0 tx=0).stop 2024-09-10T21:06:34.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c0cf810 msgr2=0x7f259c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:34.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c0cf810 0x7f259c158d30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f258800c370 tx=0x7f258800c830 comp rx=0 tx=0).stop 2024-09-10T21:06:34.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 shutdown_connections 2024-09-10T21:06:34.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259c15b4d0 0x7f259c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:34.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f257c077f70 0x7f257c07a430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:34.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259c0cf810 0x7f259c158d30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:34.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 --2- 172.21.15.100:0/878633173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f259c06eb60 0x7f259c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:34.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 >> 172.21.15.100:0/878633173 conn(0x7f259c06cb50 msgr2=0x7f259c1609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:34.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 shutdown_connections 2024-09-10T21:06:34.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34.308+0000 7f25a1e00640 1 -- 172.21.15.100:0/878633173 wait complete. 2024-09-10T21:06:34.328 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T21:06:34.328 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:06:34.328 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-10T21:06:34.329 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T21:06:34.329 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:34.329 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T21:06:34.329 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:06:34.329 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:06:34.329 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:06:34.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:34.329 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-10T21:06:34.363 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:34.364 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:06:34.365 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:34.365 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T21:06:34.365 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42665sec preferred_lft 42665sec 2024-09-10T21:06:34.365 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-10T21:06:34.365 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:34.366 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T21:06:34.366 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:34.366 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:34.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-09-10T21:06:34.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-09-10T21:06:34.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-09-10T21:06:34.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T21:06:34.366 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:34.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:34.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:34.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:34.588 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:06:34.642 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T21:06:34.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:34.645 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-10T21:06:34.681 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-10T21:06:34.681 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:06:34.681 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T21:06:34.681 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T21:06:34.682 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:06:34.682 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:34.682 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:34.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T21:06:34.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T21:06:34.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T21:06:34.682 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:34.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:34.877 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T21:06:34.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:34.912 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-10T21:06:34.987 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:34.987 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:34.987 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:34.987 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T21:06:34.987 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:35.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:35.161 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T21:06:35.162 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:35.162 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:35.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T21:06:35.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T21:06:35.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T21:06:35.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T21:06:35.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T21:06:35.162 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:35.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:35.377 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:35.377 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:35.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-10T21:06:35.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T21:06:35.377 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:35.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:35.542 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T21:06:35.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:35.542 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:35.577 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:06:35.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:35.578 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:35.652 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:06:35.750 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:35.788 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:06:35.789 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:06:35.790 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:06:35.791 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:35.791 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:35.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:35.791 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:06:35.866 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T21:06:35.866 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T21:06:35.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:06:35.966 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:36.002 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:06:36.002 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:06:36.002 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:06:36.003 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:06:36.004 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:06:36.005 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:36.005 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:36.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:36.005 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:06:36.056 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-09-10T21:06:36.051+0000 7f3d89a0f480 -1 init, newargv = 0x55c8fb61c470 newargc=15 2024-09-10T21:06:36.056 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[45888]: starting ceph client 2024-09-10T21:06:36.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[45888]: starting fuse 2024-09-10T21:06:36.085 INFO:teuthology.orchestra.run.smithi100.stdout:42 2024-09-10T21:06:36.085 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-10T21:06:36.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:06:36.085 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-10T21:06:36.085 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:36.086 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-09-10T21:06:36.087 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-10T21:06:36.247 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.45888.asok 2024-09-10T21:06:36.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:36.261 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45888.asok 2024-09-10T21:06:36.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:36.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45888.asok status 2024-09-10T21:06:36.446 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:06:36.446 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-09-10T21:06:36.446 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T21:06:36.446 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:06:36.446 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-09-10T21:06:36.446 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "45888", 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4806, 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4806 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:06:36.447 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4061712891 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4061712891 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4806 192.168.0.1:0/4061712891", 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/4061712891", 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 9, 2024-09-10T21:06:36.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 27, 2024-09-10T21:06:36.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-09-10T21:06:36.449 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-09-10T21:06:36.449 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-09-10T21:06:36.449 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:06:36.458 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T21:06:36.458 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T21:06:36.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.609+0000 7f64c7000640 1 -- 172.21.15.100:0/249435419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015b680 msgr2=0x7f64c015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:36.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.609+0000 7f64c7000640 1 --2- 172.21.15.100:0/249435419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015b680 0x7f64c015ba60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009860 tx=0x7f64b002a5a0 comp rx=0 tx=0).stop 2024-09-10T21:06:36.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.610+0000 7f64c7000640 1 -- 172.21.15.100:0/249435419 shutdown_connections 2024-09-10T21:06:36.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.610+0000 7f64c7000640 1 --2- 172.21.15.100:0/249435419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015b680 0x7f64c015ba60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:36.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.610+0000 7f64c7000640 1 -- 172.21.15.100:0/249435419 >> 172.21.15.100:0/249435419 conn(0x7f64c006cb50 msgr2=0x7f64c006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:36.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.610+0000 7f64c7000640 1 -- 172.21.15.100:0/249435419 shutdown_connections 2024-09-10T21:06:36.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.610+0000 7f64c7000640 1 -- 172.21.15.100:0/249435419 wait complete. 2024-09-10T21:06:36.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.611+0000 7f64c7000640 1 Processor -- start 2024-09-10T21:06:36.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.611+0000 7f64c7000640 1 -- start start 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.612+0000 7f64c7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64c00741e0 0x7f64c01f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.612+0000 7f64c7000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c015b680 0x7f64c0147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.612+0000 7f64c7000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015c750 0x7f64c00aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.612+0000 7f64c7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f64c00b2bf0 con 0x7f64c00741e0 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.612+0000 7f64c7000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64c00b2a70 con 0x7f64c015b680 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.612+0000 7f64c7000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f64c00b2d70 con 0x7f64c015c750 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.612+0000 7f64bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64c00741e0 0x7f64c01f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64c00741e0 0x7f64c01f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37452/0 (socket says 172.21.15.100:37452) 2024-09-10T21:06:36.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bfe00640 1 -- 172.21.15.100:0/729930158 learned_addr learned my addr 172.21.15.100:0/729930158 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bf400640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c015b680 0x7f64c0147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64c5000640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015c750 0x7f64c00aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bfe00640 1 -- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015c750 msgr2=0x7f64c00aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bfe00640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015c750 0x7f64c00aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bfe00640 1 -- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c015b680 msgr2=0x7f64c0147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bfe00640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c015b680 0x7f64c0147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bfe00640 1 -- 172.21.15.100:0/729930158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c01583a0 con 0x7f64c00741e0 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bf400640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c015b680 0x7f64c0147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64c5000640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015c750 0x7f64c00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64bfe00640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64c00741e0 0x7f64c01f8110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f64b002ab90 tx=0x7f64b0032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:36.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.613+0000 7f64b7e00640 1 -- 172.21.15.100:0/729930158 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b0040070 con 0x7f64c00741e0 2024-09-10T21:06:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.614+0000 7f64b7e00640 1 -- 172.21.15.100:0/729930158 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64b0005310 con 0x7f64c00741e0 2024-09-10T21:06:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.614+0000 7f64b7e00640 1 -- 172.21.15.100:0/729930158 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b00047a0 con 0x7f64c00741e0 2024-09-10T21:06:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.614+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c01f8650 con 0x7f64c00741e0 2024-09-10T21:06:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.614+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c0157de0 con 0x7f64c00741e0 2024-09-10T21:06:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.615+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c015f4d0 con 0x7f64c00741e0 2024-09-10T21:06:36.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.616+0000 7f64b7e00640 1 -- 172.21.15.100:0/729930158 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f64b0004940 con 0x7f64c00741e0 2024-09-10T21:06:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.617+0000 7f64b7e00640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f64a0077f70 0x7f64a007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:36.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.617+0000 7f64b7e00640 1 -- 172.21.15.100:0/729930158 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f64b00bb430 con 0x7f64c00741e0 2024-09-10T21:06:36.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.617+0000 7f64bf400640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f64a0077f70 0x7f64a007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:36.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.618+0000 7f64bf400640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f64a0077f70 0x7f64a007a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64ac001220 tx=0x7f64ac009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:36.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.621+0000 7f64b7e00640 1 -- 172.21.15.100:0/729930158 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f64c01583a0 con 0x7f64c00741e0 2024-09-10T21:06:36.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.838+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f64c00cc490 con 0x7f64c00741e0 2024-09-10T21:06:36.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.839+0000 7f64b7e00640 1 -- 172.21.15.100:0/729930158 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f64b0083be0 con 0x7f64c00741e0 2024-09-10T21:06:36.844 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f64a0077f70 msgr2=0x7f64a007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f64a0077f70 0x7f64a007a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64ac001220 tx=0x7f64ac009040 comp rx=0 tx=0).stop 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64c00741e0 msgr2=0x7f64c01f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64c00741e0 0x7f64c01f8110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f64b002ab90 tx=0x7f64b0032b90 comp rx=0 tx=0).stop 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 shutdown_connections 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c015c750 0x7f64c00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f64a0077f70 0x7f64a007a430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c015b680 0x7f64c0147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 --2- 172.21.15.100:0/729930158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64c00741e0 0x7f64c01f8110 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:36.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 >> 172.21.15.100:0/729930158 conn(0x7f64c006cb50 msgr2=0x7f64c0152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 shutdown_connections 2024-09-10T21:06:36.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:36.841+0000 7f64c7000640 1 -- 172.21.15.100:0/729930158 wait complete. 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:06:36.861 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T21:06:36.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:36.862 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-10T21:06:36.897 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2a:56:13:5b:20:3e brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:36.898 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::c876:b2ff:fedc:cb5a/64 scope link 2024-09-10T21:06:36.899 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:36.899 INFO:teuthology.orchestra.run.smithi100.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T21:06:36.899 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2a:56:13:5b:20:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:36.899 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::2856:13ff:fe5b:203e/64 scope link 2024-09-10T21:06:36.899 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:36.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:36.899 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:06:36.991 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T21:06:36.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:36.994 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-10T21:06:37.030 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-10T21:06:37.030 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:06:37.030 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T21:06:37.030 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T21:06:37.030 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:06:37.030 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:37.030 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:37.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T21:06:37.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T21:06:37.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T21:06:37.031 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:37.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:37.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:37.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:37.227 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T21:06:37.262 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T21:06:37.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:37.262 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-10T21:06:37.336 INFO:teuthology.orchestra.run.smithi100.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T21:06:37.337 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:37.337 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:37.338 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:06:37.338 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T21:06:37.338 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:37.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:37.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:37.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:37.513 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T21:06:37.569 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:37.569 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:37.569 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:37.569 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:37.569 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:37.569 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:37.569 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T21:06:37.569 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 8e:2d:d4:fc:d0:04 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T21:06:37.570 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T21:06:37.570 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:37.570 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::8c2d:d4ff:fefc:d004/64 scope link 2024-09-10T21:06:37.570 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:37.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:37.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T21:06:37.627 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 8e:2d:d4:fc:d0:04 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::8c2d:d4ff:fefc:d004/64 scope link 2024-09-10T21:06:37.628 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:37.630 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T21:06:37.631 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:37.631 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:37.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T21:06:37.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T21:06:37.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T21:06:37.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T21:06:37.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T21:06:37.631 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:37.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:37.846 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:37.846 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:06:37.846 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.1 up 2024-09-10T21:06:37.846 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T21:06:37.846 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:06:37.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:38.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:38.011 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-10T21:06:38.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:38.011 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T21:06:38.046 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T21:06:38.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:38.047 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T21:06:38.123 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:06:38.219 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:06:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:06:38.257 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:06:38.258 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:06:38.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:38.259 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:06:38.335 INFO:teuthology.orchestra.run.smithi100.stdout:42 2024-09-10T21:06:38.335 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-09-10T21:06:38.336 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-10T21:06:38.379 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:06:38.436 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:06:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:06:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:06:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:06:38.473 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:38.474 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:06:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:06:38.475 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:06:38.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:38.476 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:06:38.524 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:2024-09-10T21:06:38.520+0000 7f37ea758480 -1 init, newargv = 0x558ea01d1410 newargc=15 2024-09-10T21:06:38.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:ceph-fuse[46386]: starting ceph client 2024-09-10T21:06:38.534 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi100.stderr:ceph-fuse[46386]: starting fuse 2024-09-10T21:06:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:42 2024-09-10T21:06:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:44 2024-09-10T21:06:38.555 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-10T21:06:38.556 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.2")) 2024-09-10T21:06:38.557 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-10T21:06:38.718 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.2.46386.asok 2024-09-10T21:06:38.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:38.733 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46386.asok 2024-09-10T21:06:38.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:38.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46386.asok status 2024-09-10T21:06:38.915 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:06:38.915 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-09-10T21:06:38.915 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T21:06:38.915 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:06:38.915 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "2", 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "46386", 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4821, 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4821 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:38.916 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.2:0", 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3202339564 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.2:0", 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3202339564 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4821 192.168.0.2:0/3202339564", 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.2:0/3202339564", 2024-09-10T21:06:38.917 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-09-10T21:06:38.918 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 9, 2024-09-10T21:06:38.918 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 27, 2024-09-10T21:06:38.918 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-09-10T21:06:38.918 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-09-10T21:06:38.918 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-09-10T21:06:38.918 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:06:38.926 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T21:06:38.927 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T21:06:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.079+0000 7f8015600640 1 -- 172.21.15.100:0/2126058693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80100d1cd0 msgr2=0x7f80100afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.079+0000 7f8015600640 1 --2- 172.21.15.100:0/2126058693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80100d1cd0 0x7f80100afc00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f80100750f0 tx=0x7f800802a4a0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.080+0000 7f8015600640 1 -- 172.21.15.100:0/2126058693 shutdown_connections 2024-09-10T21:06:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.080+0000 7f8015600640 1 --2- 172.21.15.100:0/2126058693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80100d1cd0 0x7f80100afc00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.080+0000 7f8015600640 1 --2- 172.21.15.100:0/2126058693 >> v2:172.21.15.130:3300/0 conn(0x7f801015b970 0x7f8010071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.080+0000 7f8015600640 1 -- 172.21.15.100:0/2126058693 >> 172.21.15.100:0/2126058693 conn(0x7f801009a9e0 msgr2=0x7f801009adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.080+0000 7f8015600640 1 -- 172.21.15.100:0/2126058693 shutdown_connections 2024-09-10T21:06:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.080+0000 7f8015600640 1 -- 172.21.15.100:0/2126058693 wait complete. 2024-09-10T21:06:39.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.081+0000 7f8015600640 1 Processor -- start 2024-09-10T21:06:39.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.081+0000 7f8015600640 1 -- start start 2024-09-10T21:06:39.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.082+0000 7f8015600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80100cfdf0 0x7f80100b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:39.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.082+0000 7f8015600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80100d1cd0 0x7f80100b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:39.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.082+0000 7f8015600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801015b970 0x7f80100b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:39.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.082+0000 7f8015600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f80100b05c0 con 0x7f801015b970 2024-09-10T21:06:39.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.082+0000 7f8015600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80100b0440 con 0x7f80100cfdf0 2024-09-10T21:06:39.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.082+0000 7f8015600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f80100b0740 con 0x7f80100d1cd0 2024-09-10T21:06:39.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801015b970 0x7f80100b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801015b970 0x7f80100b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37478/0 (socket says 172.21.15.100:37478) 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 -- 172.21.15.100:0/897986803 learned_addr learned my addr 172.21.15.100:0/897986803 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f800fe00640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80100cfdf0 0x7f80100b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 -- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80100d1cd0 msgr2=0x7f80100b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80100d1cd0 0x7f80100b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 -- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80100cfdf0 msgr2=0x7f80100b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80100cfdf0 0x7f80100b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 -- 172.21.15.100:0/897986803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80100cc240 con 0x7f801015b970 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8014c00640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801015b970 0x7f80100b3a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8008009920 tx=0x7f8008032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8007e00640 1 -- 172.21.15.100:0/897986803 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008040070 con 0x7f801015b970 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8007e00640 1 -- 172.21.15.100:0/897986803 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8008005330 con 0x7f801015b970 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.083+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80100cc520 con 0x7f801015b970 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.084+0000 7f8007e00640 1 -- 172.21.15.100:0/897986803 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80080047a0 con 0x7f801015b970 2024-09-10T21:06:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.084+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80100ccae0 con 0x7f801015b970 2024-09-10T21:06:39.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.085+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80100b0c60 con 0x7f801015b970 2024-09-10T21:06:39.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.086+0000 7f8007e00640 1 -- 172.21.15.100:0/897986803 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f800804c030 con 0x7f801015b970 2024-09-10T21:06:39.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.087+0000 7f8007e00640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ff0077fa0 0x7f7ff007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:39.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.087+0000 7f8007e00640 1 -- 172.21.15.100:0/897986803 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f80080bb1b0 con 0x7f801015b970 2024-09-10T21:06:39.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.088+0000 7f800fe00640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ff0077fa0 0x7f7ff007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:39.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.088+0000 7f800fe00640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ff0077fa0 0x7f7ff007a460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8000005fd0 tx=0x7f8000009500 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:39.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.092+0000 7f8007e00640 1 -- 172.21.15.100:0/897986803 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f80080838d0 con 0x7f801015b970 2024-09-10T21:06:39.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.310+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f801006f720 con 0x7f801015b970 2024-09-10T21:06:39.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.311+0000 7f8007e00640 1 -- 172.21.15.100:0/897986803 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f80080831d0 con 0x7f801015b970 2024-09-10T21:06:39.315 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ff0077fa0 msgr2=0x7f7ff007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ff0077fa0 0x7f7ff007a460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8000005fd0 tx=0x7f8000009500 comp rx=0 tx=0).stop 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801015b970 msgr2=0x7f80100b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801015b970 0x7f80100b3a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8008009920 tx=0x7f8008032b90 comp rx=0 tx=0).stop 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 shutdown_connections 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801015b970 0x7f80100b3a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80100d1cd0 0x7f80100b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ff0077fa0 0x7f7ff007a460 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 --2- 172.21.15.100:0/897986803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80100cfdf0 0x7f80100b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 >> 172.21.15.100:0/897986803 conn(0x7f801009a9e0 msgr2=0x7f80100688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 shutdown_connections 2024-09-10T21:06:39.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:39.313+0000 7f8015600640 1 -- 172.21.15.100:0/897986803 wait complete. 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:06:39.335 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T21:06:39.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:39.336 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2024-09-10T21:06:39.375 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:39.376 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:39.376 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:06:39.376 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:39.376 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T21:06:39.376 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42665sec preferred_lft 42665sec 2024-09-10T21:06:39.376 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link noprefixroute 2024-09-10T21:06:39.376 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:39.377 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T21:06:39.377 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:39.377 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:39.377 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add name ceph-brx type bridge 2024-09-10T21:06:39.377 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr flush dev ceph-brx 2024-09-10T21:06:39.377 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set ceph-brx up 2024-09-10T21:06:39.377 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T21:06:39.377 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:39.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:39.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:39.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:39.801 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:06:39.858 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-09-10T21:06:39.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:39.862 DEBUG:teuthology.orchestra.run.smithi130:> route 2024-09-10T21:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2024-09-10T21:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T21:06:39.907 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T21:06:39.908 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:06:39.908 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:39.908 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:39.908 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T21:06:39.908 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T21:06:39.908 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T21:06:39.908 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:40.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:40.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:40.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:40.511 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-09-10T21:06:40.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:40.547 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2024-09-10T21:06:40.623 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:40.623 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:40.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:40.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T21:06:40.623 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:40.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:40.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:40.805 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T21:06:40.805 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:40.805 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:40.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T21:06:40.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T21:06:40.806 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T21:06:40.806 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T21:06:40.806 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T21:06:40.806 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:40.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:41.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:41.046 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:41.047 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:41.047 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2024-09-10T21:06:41.047 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T21:06:41.047 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:41.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:41.205 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:41.213 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-10T21:06:41.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:41.214 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:41.248 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T21:06:41.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:41.249 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:41.324 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2024-09-10T21:06:41.422 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/bpf 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2024-09-10T21:06:41.459 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:41.460 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:41.461 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:41.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:41.462 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2024-09-10T21:06:41.538 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T21:06:41.539 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-10T21:06:41.582 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2024-09-10T21:06:41.639 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:41.676 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/bpf 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2024-09-10T21:06:41.677 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2024-09-10T21:06:41.678 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T21:06:41.679 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T21:06:41.679 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T21:06:41.679 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T21:06:41.679 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2024-09-10T21:06:41.679 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:41.679 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:41.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:41.680 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2024-09-10T21:06:41.753 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:2024-09-10T21:06:41.749+0000 7f774311e480 -1 init, newargv = 0x559c1a32c240 newargc=15 2024-09-10T21:06:41.753 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:ceph-fuse[41263]: starting ceph client 2024-09-10T21:06:41.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:ceph-fuse[41263]: starting fuse 2024-09-10T21:06:42.858 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2024-09-10T21:06:42.918 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:42.954 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/bpf 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2024-09-10T21:06:42.955 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2024-09-10T21:06:42.956 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:42.957 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:42.957 INFO:teuthology.orchestra.run.smithi130.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:42.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:42.958 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2024-09-10T21:06:43.032 INFO:teuthology.orchestra.run.smithi130.stdout:43 2024-09-10T21:06:43.032 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-10T21:06:43.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:06:43.032 DEBUG:teuthology.orchestra.run.smithi130:> import glob 2024-09-10T21:06:43.032 DEBUG:teuthology.orchestra.run.smithi130:> import re 2024-09-10T21:06:43.032 DEBUG:teuthology.orchestra.run.smithi130:> import os 2024-09-10T21:06:43.032 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> def _find_admin_socket(client_name): 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> files = glob.glob(asok_path) 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> # Given a non-glob path, it better be there 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> if "*" not in asok_path: 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> assert(len(files) == 1) 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> return files[0] 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> for f in files: 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:06:43.033 DEBUG:teuthology.orchestra.run.smithi130:> contents = proc_f.read() 2024-09-10T21:06:43.034 DEBUG:teuthology.orchestra.run.smithi130:> if mountpoint in contents: 2024-09-10T21:06:43.034 DEBUG:teuthology.orchestra.run.smithi130:> return f 2024-09-10T21:06:43.034 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:06:43.034 DEBUG:teuthology.orchestra.run.smithi130:> 2024-09-10T21:06:43.034 DEBUG:teuthology.orchestra.run.smithi130:> print(_find_admin_socket("client.1")) 2024-09-10T21:06:43.034 DEBUG:teuthology.orchestra.run.smithi130:> ' 2024-09-10T21:06:43.193 INFO:teuthology.orchestra.run.smithi130.stdout:/var/run/ceph/ceph-client.1.41263.asok 2024-09-10T21:06:43.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:43.208 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41263.asok 2024-09-10T21:06:43.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:43.208 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41263.asok status 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": { 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "entity_id": "1", 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "hostname": "smithi130", 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "pid": "41263", 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "root": "/" 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-10T21:06:43.389 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_count": 0, 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_pinned_count": 0, 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4616, 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "inst": { 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "name": { 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "client", 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "num": 4616 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2871358253 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-10T21:06:43.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2871358253 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "inst_str": "client.4616 192.168.0.1:0/2871358253", 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "addr_str": "192.168.0.1:0/2871358253", 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "inode_count": 1, 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_epoch": 9, 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch": 27, 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch_barrier": 0, 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklisted": false, 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs" 2024-09-10T21:06:43.391 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-10T21:06:43.400 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T21:06:43.400 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T21:06:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.655+0000 7f2626c00640 1 -- 172.21.15.100:0/514130063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 msgr2=0x7f26200aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.655+0000 7f2626c00640 1 --2- 172.21.15.100:0/514130063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 0x7f26200aed60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2614009830 tx=0x7f261402a5b0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.655+0000 7f2626c00640 1 -- 172.21.15.100:0/514130063 shutdown_connections 2024-09-10T21:06:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.655+0000 7f2626c00640 1 --2- 172.21.15.100:0/514130063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 0x7f26200aed60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.655+0000 7f2626c00640 1 -- 172.21.15.100:0/514130063 >> 172.21.15.100:0/514130063 conn(0x7f26200b15d0 msgr2=0x7f26200b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.655+0000 7f2626c00640 1 -- 172.21.15.100:0/514130063 shutdown_connections 2024-09-10T21:06:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.655+0000 7f2626c00640 1 -- 172.21.15.100:0/514130063 wait complete. 2024-09-10T21:06:43.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.657+0000 7f2626c00640 1 Processor -- start 2024-09-10T21:06:43.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.657+0000 7f2626c00640 1 -- start start 2024-09-10T21:06:43.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f262006e250 0x7f26200b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:43.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f262006e6e0 0x7f2620206330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:43.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 0x7f26201f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:43.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26200cc230 con 0x7f262016a400 2024-09-10T21:06:43.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f26200cc3b0 con 0x7f262006e6e0 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f26200cc530 con 0x7f262006e250 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 0x7f26201f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 0x7f26201f7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40052/0 (socket says 172.21.15.100:40052) 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2626200640 1 -- 172.21.15.100:0/745637482 learned_addr learned my addr 172.21.15.100:0/745637482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.658+0000 7f2625800640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f262006e250 0x7f26200b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f2624e00640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f262006e6e0 0x7f2620206330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f2626200640 1 -- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f262006e250 msgr2=0x7f26200b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f2626200640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f262006e250 0x7f26200b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f2626200640 1 -- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f262006e6e0 msgr2=0x7f2620206330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f2626200640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f262006e6e0 0x7f2620206330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f2626200640 1 -- 172.21.15.100:0/745637482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26200b5440 con 0x7f262016a400 2024-09-10T21:06:43.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f2626200640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 0x7f26201f7270 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f261800c700 tx=0x7f261800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:43.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f261d600640 1 -- 172.21.15.100:0/745637482 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618003b70 con 0x7f262016a400 2024-09-10T21:06:43.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f261d600640 1 -- 172.21.15.100:0/745637482 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2618003d10 con 0x7f262016a400 2024-09-10T21:06:43.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f261d600640 1 -- 172.21.15.100:0/745637482 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261800aab0 con 0x7f262016a400 2024-09-10T21:06:43.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.659+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26200b5720 con 0x7f262016a400 2024-09-10T21:06:43.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.660+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26200b2a70 con 0x7f262016a400 2024-09-10T21:06:43.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.661+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26200aed60 con 0x7f262016a400 2024-09-10T21:06:43.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.662+0000 7f261d600640 1 -- 172.21.15.100:0/745637482 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f261800ac50 con 0x7f262016a400 2024-09-10T21:06:43.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.663+0000 7f261d600640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2600077f70 0x7f260007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:43.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.663+0000 7f261d600640 1 -- 172.21.15.100:0/745637482 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2618099d00 con 0x7f262016a400 2024-09-10T21:06:43.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.663+0000 7f2625800640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2600077f70 0x7f260007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:43.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.664+0000 7f2625800640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2600077f70 0x7f260007a430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2614034000 tx=0x7f2614004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:43.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.667+0000 7f261d600640 1 -- 172.21.15.100:0/745637482 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2618061e60 con 0x7f262016a400 2024-09-10T21:06:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.899+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f26200c9b00 con 0x7f262016a400 2024-09-10T21:06:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.899+0000 7f261d600640 1 -- 172.21.15.100:0/745637482 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f2618066890 con 0x7f262016a400 2024-09-10T21:06:43.903 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2600077f70 msgr2=0x7f260007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2600077f70 0x7f260007a430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2614034000 tx=0x7f2614004730 comp rx=0 tx=0).stop 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 msgr2=0x7f26201f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 0x7f26201f7270 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f261800c700 tx=0x7f261800cbc0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 shutdown_connections 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262016a400 0x7f26201f7270 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2600077f70 0x7f260007a430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f262006e6e0 0x7f2620206330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 --2- 172.21.15.100:0/745637482 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f262006e250 0x7f26200b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 >> 172.21.15.100:0/745637482 conn(0x7f26200b15d0 msgr2=0x7f262016cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 shutdown_connections 2024-09-10T21:06:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:43.902+0000 7f2626c00640 1 -- 172.21.15.100:0/745637482 wait complete. 2024-09-10T21:06:43.921 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T21:06:43.922 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:06:43.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2024-09-10T21:06:43.922 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T21:06:43.922 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T21:06:43.922 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T21:06:43.922 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:06:43.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:06:43.922 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T21:06:43.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:43.923 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2024-09-10T21:06:43.958 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:43.958 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:43.958 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:43.958 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:43.958 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:43.958 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:43.958 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:43.958 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42661sec preferred_lft 42661sec 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link noprefixroute 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 3e:e9:3a:6e:6d:35 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:06:43.959 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T21:06:43.960 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:43.960 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::641f:bbff:fed0:77e9/64 scope link 2024-09-10T21:06:43.960 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:43.960 INFO:teuthology.orchestra.run.smithi130.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T21:06:43.960 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 3e:e9:3a:6e:6d:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:43.960 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::3ce9:3aff:fe6e:6d35/64 scope link 2024-09-10T21:06:43.960 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:43.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:43.960 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:06:44.051 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-09-10T21:06:44.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:44.054 DEBUG:teuthology.orchestra.run.smithi130:> route 2024-09-10T21:06:44.090 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2024-09-10T21:06:44.090 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:06:44.090 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T21:06:44.090 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T21:06:44.090 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:06:44.090 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:44.090 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:44.091 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T21:06:44.091 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T21:06:44.091 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T21:06:44.091 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:44.207 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:44.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:44.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:44.286 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-09-10T21:06:44.321 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T21:06:44.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:44.323 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2024-09-10T21:06:44.397 INFO:teuthology.orchestra.run.smithi130.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T21:06:44.398 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:44.398 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:44.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T21:06:44.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T21:06:44.398 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:44.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:44.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:44.574 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T21:06:44.629 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether d6:e8:cb:86:5b:37 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::d4e8:cbff:fe86:5b37/64 scope link 2024-09-10T21:06:44.630 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:44.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:44.632 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T21:06:44.687 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether d6:e8:cb:86:5b:37 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::d4e8:cbff:fe86:5b37/64 scope link 2024-09-10T21:06:44.688 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:06:44.691 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T21:06:44.691 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:44.691 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:44.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T21:06:44.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T21:06:44.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T21:06:44.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T21:06:44.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T21:06:44.692 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:44.770 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:44.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:44.911 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:06:44.911 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-09-10T21:06:44.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.1 up 2024-09-10T21:06:44.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T21:06:44.911 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-09-10T21:06:44.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:06:45.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:45.076 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-10T21:06:45.076 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:45.077 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T21:06:45.111 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T21:06:45.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:06:45.112 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T21:06:45.186 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2024-09-10T21:06:45.282 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:45.318 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2024-09-10T21:06:45.318 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2024-09-10T21:06:45.318 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2024-09-10T21:06:45.318 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2024-09-10T21:06:45.318 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2024-09-10T21:06:45.318 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2024-09-10T21:06:45.318 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/bpf 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:45.319 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T21:06:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T21:06:45.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:45.321 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2024-09-10T21:06:45.395 INFO:teuthology.orchestra.run.smithi130.stdout:43 2024-09-10T21:06:45.396 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-09-10T21:06:45.396 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-10T21:06:45.440 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2024-09-10T21:06:45.496 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:06:45.532 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/bpf 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:06:45.533 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T21:06:45.534 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T21:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T21:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2024-09-10T21:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T21:06:45.535 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T21:06:45.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:45.536 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2024-09-10T21:06:45.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:2024-09-10T21:06:45.579+0000 7fba04229480 -1 init, newargv = 0x55b05e1953b0 newargc=15 2024-09-10T21:06:45.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:ceph-fuse[41787]: starting ceph client 2024-09-10T21:06:45.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:ceph-fuse[41787]: starting fuse 2024-09-10T21:06:45.614 INFO:teuthology.orchestra.run.smithi130.stdout:43 2024-09-10T21:06:45.614 INFO:teuthology.orchestra.run.smithi130.stdout:44 2024-09-10T21:06:45.614 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-09-10T21:06:45.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:06:45.614 DEBUG:teuthology.orchestra.run.smithi130:> import glob 2024-09-10T21:06:45.614 DEBUG:teuthology.orchestra.run.smithi130:> import re 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> import os 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> def _find_admin_socket(client_name): 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> files = glob.glob(asok_path) 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> # Given a non-glob path, it better be there 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> if "*" not in asok_path: 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> assert(len(files) == 1) 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> return files[0] 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> 2024-09-10T21:06:45.615 DEBUG:teuthology.orchestra.run.smithi130:> for f in files: 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> contents = proc_f.read() 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> if mountpoint in contents: 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> return f 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> print(_find_admin_socket("client.3")) 2024-09-10T21:06:45.616 DEBUG:teuthology.orchestra.run.smithi130:> ' 2024-09-10T21:06:45.777 INFO:teuthology.orchestra.run.smithi130.stdout:/var/run/ceph/ceph-client.3.41787.asok 2024-09-10T21:06:45.780 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-10T21:06:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:06:45.791 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41787.asok 2024-09-10T21:06:45.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:45.791 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41787.asok status 2024-09-10T21:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-10T21:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": { 2024-09-10T21:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T21:06:45.974 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "entity_id": "3", 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "hostname": "smithi130", 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "pid": "41787", 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "root": "/" 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_count": 0, 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_pinned_count": 0, 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4738, 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "inst": { 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "name": { 2024-09-10T21:06:45.975 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "client", 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "num": 4738 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.2:0", 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 121789905 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.2:0", 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 121789905 2024-09-10T21:06:45.976 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "inst_str": "client.4738 192.168.0.2:0/121789905", 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "addr_str": "192.168.0.2:0/121789905", 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "inode_count": 1, 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_epoch": 9, 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch": 27, 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch_barrier": 0, 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklisted": false, 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs" 2024-09-10T21:06:45.977 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-10T21:06:45.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:45.986 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-09-10T21:06:45.986 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:46.027 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-09-10T21:06:46.027 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:46.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:46.027 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:46.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:46.127 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-09-10T21:06:46.127 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-10T21:06:46.163 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-09-10T21:06:46.163 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-10T21:06:46.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:46.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T21:06:46.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:46.260 DEBUG:teuthology.orchestra.run.smithi130:> stat --file-system '--printf=%T 2024-09-10T21:06:46.261 DEBUG:teuthology.orchestra.run.smithi130:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:46.297 INFO:teuthology.orchestra.run.smithi130.stdout:fuseblk 2024-09-10T21:06:46.297 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:46.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:46.297 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:46.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:46.394 DEBUG:teuthology.orchestra.run.smithi130:> stat --file-system '--printf=%T 2024-09-10T21:06:46.394 DEBUG:teuthology.orchestra.run.smithi130:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-10T21:06:46.429 INFO:teuthology.orchestra.run.smithi130.stdout:fuseblk 2024-09-10T21:06:46.430 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-10T21:06:46.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:46.430 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T21:06:46.526 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T21:06:46.549 INFO:tasks.cephfs_test_runner:Starting test: test_flush (tasks.cephfs.test_readahead.TestReadahead) 2024-09-10T21:06:46.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.703+0000 7f3705400640 1 -- 172.21.15.100:0/1699155065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37000cec80 msgr2=0x7f370015bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.703+0000 7f3705400640 1 --2- 172.21.15.100:0/1699155065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37000cec80 0x7f370015bcd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009830 tx=0x7f36ec02a510 comp rx=0 tx=0).stop 2024-09-10T21:06:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.703+0000 7f3705400640 1 -- 172.21.15.100:0/1699155065 shutdown_connections 2024-09-10T21:06:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.703+0000 7f3705400640 1 --2- 172.21.15.100:0/1699155065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37000cec80 0x7f370015bcd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.703+0000 7f3705400640 1 --2- 172.21.15.100:0/1699155065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37000aea30 0x7f3700073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.703+0000 7f3705400640 1 -- 172.21.15.100:0/1699155065 >> 172.21.15.100:0/1699155065 conn(0x7f370006d500 msgr2=0x7f37000b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.703+0000 7f3705400640 1 -- 172.21.15.100:0/1699155065 shutdown_connections 2024-09-10T21:06:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.703+0000 7f3705400640 1 -- 172.21.15.100:0/1699155065 wait complete. 2024-09-10T21:06:46.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.705+0000 7f3705400640 1 Processor -- start 2024-09-10T21:06:46.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.705+0000 7f3705400640 1 -- start start 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.705+0000 7f3705400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37000aea30 0x7f37001452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.705+0000 7f3705400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37000cec80 0x7f37000cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f3705400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f370015c210 0x7f37000ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f3705400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37000cc110 con 0x7f37000aea30 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f3705400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37000af020 con 0x7f37000cec80 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f3705400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f37000cc290 con 0x7f370015c210 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37000aea30 0x7f37001452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37000aea30 0x7f37001452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40058/0 (socket says 172.21.15.100:40058) 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ffe00640 1 -- 172.21.15.100:0/79433458 learned_addr learned my addr 172.21.15.100:0/79433458 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ff400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37000cec80 0x7f37000cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f3704a00640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f370015c210 0x7f37000ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ffe00640 1 -- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f370015c210 msgr2=0x7f37000ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ffe00640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f370015c210 0x7f37000ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ffe00640 1 -- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37000cec80 msgr2=0x7f37000cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ffe00640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37000cec80 0x7f37000cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.706+0000 7f36ffe00640 1 -- 172.21.15.100:0/79433458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37001f7de0 con 0x7f37000aea30 2024-09-10T21:06:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.707+0000 7f36ffe00640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37000aea30 0x7f37001452a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f36f000ea20 tx=0x7f36f000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.707+0000 7f36f7e00640 1 -- 172.21.15.100:0/79433458 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f000cd80 con 0x7f37000aea30 2024-09-10T21:06:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.707+0000 7f36f7e00640 1 -- 172.21.15.100:0/79433458 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36f0010430 con 0x7f37000aea30 2024-09-10T21:06:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.707+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37001f80c0 con 0x7f37000aea30 2024-09-10T21:06:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.707+0000 7f36f7e00640 1 -- 172.21.15.100:0/79433458 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0010840 con 0x7f37000aea30 2024-09-10T21:06:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.707+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37001f8680 con 0x7f37000aea30 2024-09-10T21:06:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.708+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37000cc820 con 0x7f37000aea30 2024-09-10T21:06:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.709+0000 7f36f7e00640 1 -- 172.21.15.100:0/79433458 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f36f00109e0 con 0x7f37000aea30 2024-09-10T21:06:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.711+0000 7f36f7e00640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f36e0077fa0 0x7f36e007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.711+0000 7f36f7e00640 1 -- 172.21.15.100:0/79433458 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f36f009ab40 con 0x7f37000aea30 2024-09-10T21:06:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.711+0000 7f36ff400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f36e0077fa0 0x7f36e007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.712+0000 7f36ff400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f36e0077fa0 0x7f36e007a460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36ec034000 tx=0x7f36ec004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:46.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.715+0000 7f36f7e00640 1 -- 172.21.15.100:0/79433458 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f36f0062ca0 con 0x7f37000aea30 2024-09-10T21:06:46.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.909+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f370006ef00 con 0x7f37000aea30 2024-09-10T21:06:46.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.910+0000 7f36f7e00640 1 -- 172.21.15.100:0/79433458 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18907 (secure 0 0 0) 0x7f36f00676d0 con 0x7f37000aea30 2024-09-10T21:06:46.914 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:46.914 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:46.721596+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f36e0077fa0 msgr2=0x7f36e007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f36e0077fa0 0x7f36e007a460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36ec034000 tx=0x7f36ec004730 comp rx=0 tx=0).stop 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37000aea30 msgr2=0x7f37001452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37000aea30 0x7f37001452a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f36f000ea20 tx=0x7f36f000eee0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 shutdown_connections 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f370015c210 0x7f37000ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f36e0077fa0 0x7f36e007a460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37000cec80 0x7f37000cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 --2- 172.21.15.100:0/79433458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37000aea30 0x7f37001452a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 >> 172.21.15.100:0/79433458 conn(0x7f370006d500 msgr2=0x7f37000b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 shutdown_connections 2024-09-10T21:06:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:46.913+0000 7f3705400640 1 -- 172.21.15.100:0/79433458 wait complete. 2024-09-10T21:06:46.933 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T21:05:56.711179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T21:06:05.121377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T21:06:06.089408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T21:06:09.739207+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-10T21:06:46.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T21:06:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.091+0000 7f9309200640 1 -- 172.21.15.100:0/1104362054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e8004800 msgr2=0x7f92e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.091+0000 7f9309200640 1 --2- 172.21.15.100:0/1104362054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e8004800 0x7f92e8004c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009b50 tx=0x7f92e8005830 comp rx=0 tx=0).stop 2024-09-10T21:06:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.091+0000 7f9309200640 1 -- 172.21.15.100:0/1104362054 shutdown_connections 2024-09-10T21:06:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.091+0000 7f9309200640 1 --2- 172.21.15.100:0/1104362054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e8004800 0x7f92e8004c80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.091+0000 7f9309200640 1 -- 172.21.15.100:0/1104362054 >> 172.21.15.100:0/1104362054 conn(0x7f930406cb50 msgr2=0x7f930406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.091+0000 7f9309200640 1 -- 172.21.15.100:0/1104362054 shutdown_connections 2024-09-10T21:06:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.091+0000 7f9309200640 1 -- 172.21.15.100:0/1104362054 wait complete. 2024-09-10T21:06:47.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.093+0000 7f9309200640 1 Processor -- start 2024-09-10T21:06:47.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.093+0000 7f9309200640 1 -- start start 2024-09-10T21:06:47.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9309200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92e8004800 0x7f9304145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9309200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9304145ed0 0x7f93041484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9309200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93041489e0 0x7f9304159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9309200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f930415f650 con 0x7f9304145ed0 2024-09-10T21:06:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9309200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f930415f4d0 con 0x7f93041489e0 2024-09-10T21:06:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9309200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f930415f7d0 con 0x7f92e8004800 2024-09-10T21:06:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9301400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9304145ed0 0x7f93041484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9301400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9304145ed0 0x7f93041484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40084/0 (socket says 172.21.15.100:40084) 2024-09-10T21:06:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9301400640 1 -- 172.21.15.100:0/2311949684 learned_addr learned my addr 172.21.15.100:0/2311949684 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9301400640 1 -- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92e8004800 msgr2=0x7f9304145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9301400640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92e8004800 0x7f9304145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9301400640 1 -- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93041489e0 msgr2=0x7f9304159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9301400640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93041489e0 0x7f9304159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.094+0000 7f9301400640 1 -- 172.21.15.100:0/2311949684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9304159dd0 con 0x7f9304145ed0 2024-09-10T21:06:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.095+0000 7f9301400640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9304145ed0 0x7f93041484a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009a70 tx=0x7f92f00336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.095+0000 7f92fa000640 1 -- 172.21.15.100:0/2311949684 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0038040 con 0x7f9304145ed0 2024-09-10T21:06:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.095+0000 7f92fa000640 1 -- 172.21.15.100:0/2311949684 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92f0041070 con 0x7f9304145ed0 2024-09-10T21:06:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.095+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930415a0b0 con 0x7f9304145ed0 2024-09-10T21:06:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.095+0000 7f92fa000640 1 -- 172.21.15.100:0/2311949684 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0033df0 con 0x7f9304145ed0 2024-09-10T21:06:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.095+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930415a670 con 0x7f9304145ed0 2024-09-10T21:06:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.096+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93040cf860 con 0x7f9304145ed0 2024-09-10T21:06:47.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.097+0000 7f92fa000640 1 -- 172.21.15.100:0/2311949684 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f92f003b070 con 0x7f9304145ed0 2024-09-10T21:06:47.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.098+0000 7f92fa000640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f92e4077fa0 0x7f92e407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.099+0000 7f92fa000640 1 -- 172.21.15.100:0/2311949684 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6706+0+0 (secure 0 0 0) 0x7f92f00ba770 con 0x7f9304145ed0 2024-09-10T21:06:47.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.099+0000 7f9301e00640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f92e4077fa0 0x7f92e407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.100+0000 7f9301e00640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f92e4077fa0 0x7f92e407a460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92f4001d40 tx=0x7f92f4001c90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:47.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.102+0000 7f92fa000640 1 -- 172.21.15.100:0/2311949684 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f92f0082de0 con 0x7f9304145ed0 2024-09-10T21:06:47.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.285+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f93040cc490 con 0x7f9304145ed0 2024-09-10T21:06:47.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.285+0000 7f92fa000640 1 -- 172.21.15.100:0/2311949684 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f92f00826e0 con 0x7f9304145ed0 2024-09-10T21:06:47.289 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f92e4077fa0 msgr2=0x7f92e407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f92e4077fa0 0x7f92e407a460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92f4001d40 tx=0x7f92f4001c90 comp rx=0 tx=0).stop 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9304145ed0 msgr2=0x7f93041484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9304145ed0 0x7f93041484a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009a70 tx=0x7f92f00336f0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 shutdown_connections 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f92e4077fa0 0x7f92e407a460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93041489e0 0x7f9304159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9304145ed0 0x7f93041484a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 --2- 172.21.15.100:0/2311949684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92e8004800 0x7f9304145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 >> 172.21.15.100:0/2311949684 conn(0x7f930406cb50 msgr2=0x7f930415d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:47.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 shutdown_connections 2024-09-10T21:06:47.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.288+0000 7f9309200640 1 -- 172.21.15.100:0/2311949684 wait complete. 2024-09-10T21:06:47.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T21:06:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.464+0000 7f2dd9e00640 1 -- 172.21.15.100:0/2153127951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd415b4d0 msgr2=0x7f2dd415ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.464+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/2153127951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd415b4d0 0x7f2dd415ea60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4005fd0 tx=0x7f2dc402a670 comp rx=0 tx=0).stop 2024-09-10T21:06:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.464+0000 7f2dd9e00640 1 -- 172.21.15.100:0/2153127951 shutdown_connections 2024-09-10T21:06:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.464+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/2153127951 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2dd40cf810 0x7f2dd4161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.464+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/2153127951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd415b4d0 0x7f2dd415ea60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.464+0000 7f2dd9e00640 1 -- 172.21.15.100:0/2153127951 >> 172.21.15.100:0/2153127951 conn(0x7f2dd406cb50 msgr2=0x7f2dd406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.464+0000 7f2dd9e00640 1 -- 172.21.15.100:0/2153127951 shutdown_connections 2024-09-10T21:06:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.464+0000 7f2dd9e00640 1 -- 172.21.15.100:0/2153127951 wait complete. 2024-09-10T21:06:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.465+0000 7f2dd9e00640 1 Processor -- start 2024-09-10T21:06:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.466+0000 7f2dd9e00640 1 -- start start 2024-09-10T21:06:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.466+0000 7f2dd9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd406eb60 0x7f2dd41f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.466+0000 7f2dd9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd40cf810 0x7f2dd4157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.466+0000 7f2dd9e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2dd415b4d0 0x7f2dd40c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.466+0000 7f2dd9e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd406f380 con 0x7f2dd406eb60 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.466+0000 7f2dd9e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd406f200 con 0x7f2dd40cf810 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.466+0000 7f2dd9e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd40c7270 con 0x7f2dd415b4d0 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd406eb60 0x7f2dd41f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd406eb60 0x7f2dd41f4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40102/0 (socket says 172.21.15.100:40102) 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 -- 172.21.15.100:0/1355655039 learned_addr learned my addr 172.21.15.100:0/1355655039 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2000640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd40cf810 0x7f2dd4157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd3400640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2dd415b4d0 0x7f2dd40c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 -- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2dd415b4d0 msgr2=0x7f2dd40c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2dd415b4d0 0x7f2dd40c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 -- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd40cf810 msgr2=0x7f2dd4157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd40cf810 0x7f2dd4157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 -- 172.21.15.100:0/1355655039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd40c6660 con 0x7f2dd406eb60 2024-09-10T21:06:47.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.467+0000 7f2dd2a00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd406eb60 0x7f2dd41f4390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4034040 tx=0x7f2dc40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:47.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.468+0000 7f2dcb400640 1 -- 172.21.15.100:0/1355655039 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc403e030 con 0x7f2dd406eb60 2024-09-10T21:06:47.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.468+0000 7f2dcb400640 1 -- 172.21.15.100:0/1355655039 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dc4003d90 con 0x7f2dd406eb60 2024-09-10T21:06:47.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.468+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd40c6940 con 0x7f2dd406eb60 2024-09-10T21:06:47.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.468+0000 7f2dcb400640 1 -- 172.21.15.100:0/1355655039 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4035040 con 0x7f2dd406eb60 2024-09-10T21:06:47.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.468+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd40c6f00 con 0x7f2dd406eb60 2024-09-10T21:06:47.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.469+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd40b34c0 con 0x7f2dd406eb60 2024-09-10T21:06:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.470+0000 7f2dcb400640 1 -- 172.21.15.100:0/1355655039 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2dc40049e0 con 0x7f2dd406eb60 2024-09-10T21:06:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.471+0000 7f2dcb400640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2db4077f70 0x7f2db407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.471+0000 7f2dcb400640 1 -- 172.21.15.100:0/1355655039 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6706+0+0 (secure 0 0 0) 0x7f2dc40bada0 con 0x7f2dd406eb60 2024-09-10T21:06:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.472+0000 7f2dd2000640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2db4077f70 0x7f2db407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.472+0000 7f2dd2000640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2db4077f70 0x7f2db407a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2dd41f5500 tx=0x7f2dc000b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:47.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.476+0000 7f2dcb400640 1 -- 172.21.15.100:0/1355655039 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2dc4082e50 con 0x7f2dd406eb60 2024-09-10T21:06:47.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.658+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2dd40b48e0 con 0x7f2dd406eb60 2024-09-10T21:06:47.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.658+0000 7f2dcb400640 1 -- 172.21.15.100:0/1355655039 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f2dc4087880 con 0x7f2dd406eb60 2024-09-10T21:06:47.662 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-09-10T21:06:47.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2db4077f70 msgr2=0x7f2db407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2db4077f70 0x7f2db407a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2dd41f5500 tx=0x7f2dc000b390 comp rx=0 tx=0).stop 2024-09-10T21:06:47.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd406eb60 msgr2=0x7f2dd41f4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd406eb60 0x7f2dd41f4390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4034040 tx=0x7f2dc40038a0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 shutdown_connections 2024-09-10T21:06:47.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2dd415b4d0 0x7f2dd40c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2db4077f70 0x7f2db407a430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd40cf810 0x7f2dd4157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 --2- 172.21.15.100:0/1355655039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dd406eb60 0x7f2dd41f4390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.660+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 >> 172.21.15.100:0/1355655039 conn(0x7f2dd406cb50 msgr2=0x7f2dd4161340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:47.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.661+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 shutdown_connections 2024-09-10T21:06:47.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.661+0000 7f2dd9e00640 1 -- 172.21.15.100:0/1355655039 wait complete. 2024-09-10T21:06:47.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 -- 172.21.15.100:0/3396017540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3415eba0 msgr2=0x7fea34070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 --2- 172.21.15.100:0/3396017540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3415eba0 0x7fea34070b20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea340adbd0 tx=0x7fea2002a560 comp rx=0 tx=0).stop 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 -- 172.21.15.100:0/3396017540 shutdown_connections 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 --2- 172.21.15.100:0/3396017540 >> v2:172.21.15.130:3300/0 conn(0x7fea34071060 0x7fea3406fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 --2- 172.21.15.100:0/3396017540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3415eba0 0x7fea34070b20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 --2- 172.21.15.100:0/3396017540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3415b460 0x7fea340af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 -- 172.21.15.100:0/3396017540 >> 172.21.15.100:0/3396017540 conn(0x7fea340b2200 msgr2=0x7fea340cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 -- 172.21.15.100:0/3396017540 shutdown_connections 2024-09-10T21:06:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.845+0000 7fea3a200640 1 -- 172.21.15.100:0/3396017540 wait complete. 2024-09-10T21:06:47.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.847+0000 7fea3a200640 1 Processor -- start 2024-09-10T21:06:47.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.847+0000 7fea3a200640 1 -- start start 2024-09-10T21:06:47.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea3a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea34071060 0x7fea341f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea3a200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3415b460 0x7fea34157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea3a200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3415eba0 0x7fea3406cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea3a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fea340cdf80 con 0x7fea34071060 2024-09-10T21:06:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea3a200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea340cde00 con 0x7fea3415eba0 2024-09-10T21:06:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea3a200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fea340ce100 con 0x7fea3415b460 2024-09-10T21:06:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea38e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea34071060 0x7fea341f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea38e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea34071060 0x7fea341f7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40118/0 (socket says 172.21.15.100:40118) 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea38e00640 1 -- 172.21.15.100:0/2105550806 learned_addr learned my addr 172.21.15.100:0/2105550806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea39800640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3415eba0 0x7fea3406cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea33e00640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3415b460 0x7fea34157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea38e00640 1 -- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3415b460 msgr2=0x7fea34157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea38e00640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3415b460 0x7fea34157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea38e00640 1 -- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3415eba0 msgr2=0x7fea3406cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea38e00640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3415eba0 0x7fea3406cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea38e00640 1 -- 172.21.15.100:0/2105550806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea340c55c0 con 0x7fea34071060 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.848+0000 7fea39800640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3415eba0 0x7fea3406cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.849+0000 7fea38e00640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea34071060 0x7fea341f7f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fea2800e9f0 tx=0x7fea2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.849+0000 7fea30c00640 1 -- 172.21.15.100:0/2105550806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2800cd80 con 0x7fea34071060 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.849+0000 7fea30c00640 1 -- 172.21.15.100:0/2105550806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea28005020 con 0x7fea34071060 2024-09-10T21:06:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.849+0000 7fea30c00640 1 -- 172.21.15.100:0/2105550806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28005450 con 0x7fea34071060 2024-09-10T21:06:47.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.849+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea340c58a0 con 0x7fea34071060 2024-09-10T21:06:47.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.849+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea340b3250 con 0x7fea34071060 2024-09-10T21:06:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.850+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea340b51d0 con 0x7fea34071060 2024-09-10T21:06:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.851+0000 7fea30c00640 1 -- 172.21.15.100:0/2105550806 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fea280047a0 con 0x7fea34071060 2024-09-10T21:06:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.852+0000 7fea30c00640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea14077fa0 0x7fea1407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.852+0000 7fea30c00640 1 -- 172.21.15.100:0/2105550806 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fea2809ac00 con 0x7fea34071060 2024-09-10T21:06:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.853+0000 7fea33e00640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea14077fa0 0x7fea1407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.853+0000 7fea33e00640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea14077fa0 0x7fea1407a460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea20033000 tx=0x7fea20004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:47.856+0000 7fea30c00640 1 -- 172.21.15.100:0/2105550806 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fea280633c0 con 0x7fea34071060 2024-09-10T21:06:48.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.043+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fea340af480 con 0x7fea34071060 2024-09-10T21:06:48.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.043+0000 7fea30c00640 1 -- 172.21.15.100:0/2105550806 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fea28062cc0 con 0x7fea34071060 2024-09-10T21:06:48.047 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-09-10T21:06:48.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.045+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea14077fa0 msgr2=0x7fea1407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.045+0000 7fea3a200640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea14077fa0 0x7fea1407a460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea20033000 tx=0x7fea20004730 comp rx=0 tx=0).stop 2024-09-10T21:06:48.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.045+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea34071060 msgr2=0x7fea341f7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.045+0000 7fea3a200640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea34071060 0x7fea341f7f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fea2800e9f0 tx=0x7fea2800edf0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.046+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 shutdown_connections 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.046+0000 7fea3a200640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea14077fa0 0x7fea1407a460 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.046+0000 7fea3a200640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3415eba0 0x7fea3406cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.046+0000 7fea3a200640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3415b460 0x7fea34157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.046+0000 7fea3a200640 1 --2- 172.21.15.100:0/2105550806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea34071060 0x7fea341f7f10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.046+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 >> 172.21.15.100:0/2105550806 conn(0x7fea340b2200 msgr2=0x7fea3415f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.046+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 shutdown_connections 2024-09-10T21:06:48.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.046+0000 7fea3a200640 1 -- 172.21.15.100:0/2105550806 wait complete. 2024-09-10T21:06:48.066 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-10T21:06:48.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.222+0000 7f8795200640 1 -- 172.21.15.100:0/3473661032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87900741e0 msgr2=0x7f879015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.222+0000 7f8795200640 1 --2- 172.21.15.100:0/3473661032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87900741e0 0x7f879015f4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8790070770 tx=0x7f877c02a5f0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.222+0000 7f8795200640 1 -- 172.21.15.100:0/3473661032 shutdown_connections 2024-09-10T21:06:48.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.222+0000 7f8795200640 1 --2- 172.21.15.100:0/3473661032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87900741e0 0x7f879015f4d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.222+0000 7f8795200640 1 --2- 172.21.15.100:0/3473661032 >> v2:172.21.15.130:3300/0 conn(0x7f879015b680 0x7f879015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.222+0000 7f8795200640 1 -- 172.21.15.100:0/3473661032 >> 172.21.15.100:0/3473661032 conn(0x7f879006cb50 msgr2=0x7f879006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:48.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.222+0000 7f8795200640 1 -- 172.21.15.100:0/3473661032 shutdown_connections 2024-09-10T21:06:48.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.222+0000 7f8795200640 1 -- 172.21.15.100:0/3473661032 wait complete. 2024-09-10T21:06:48.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.224+0000 7f8795200640 1 Processor -- start 2024-09-10T21:06:48.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.224+0000 7f8795200640 1 -- start start 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f8795200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87900741e0 0x7f87900af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f8795200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f879015b680 0x7f879014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f8795200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f879015c750 0x7f8790155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f8795200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f87900b2860 con 0x7f879015c750 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f8795200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f879015cf00 con 0x7f87900741e0 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f8795200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f87900b29e0 con 0x7f879015b680 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f879015c750 0x7f8790155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f879015c750 0x7f8790155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40138/0 (socket says 172.21.15.100:40138) 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878e800640 1 -- 172.21.15.100:0/2177281413 learned_addr learned my addr 172.21.15.100:0/2177281413 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878de00640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87900741e0 0x7f87900af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878d400640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f879015b680 0x7f879014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:48.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878e800640 1 -- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f879015b680 msgr2=0x7f879014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878e800640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f879015b680 0x7f879014b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878e800640 1 -- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87900741e0 msgr2=0x7f87900af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.225+0000 7f878e800640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87900741e0 0x7f87900af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.226+0000 7f878e800640 1 -- 172.21.15.100:0/2177281413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87901f7db0 con 0x7f879015c750 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.226+0000 7f878e800640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f879015c750 0x7f8790155cf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f878800c3c0 tx=0x7f878800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.226+0000 7f8786000640 1 -- 172.21.15.100:0/2177281413 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8788017070 con 0x7f879015c750 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.226+0000 7f8786000640 1 -- 172.21.15.100:0/2177281413 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87880053c0 con 0x7f879015c750 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.226+0000 7f8786000640 1 -- 172.21.15.100:0/2177281413 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8788003850 con 0x7f879015c750 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.226+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87901f8090 con 0x7f879015c750 2024-09-10T21:06:48.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.226+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87901f8650 con 0x7f879015c750 2024-09-10T21:06:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.227+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879015f4d0 con 0x7f879015c750 2024-09-10T21:06:48.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.228+0000 7f8786000640 1 -- 172.21.15.100:0/2177281413 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f87880039f0 con 0x7f879015c750 2024-09-10T21:06:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.229+0000 7f8786000640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8770077f70 0x7f877007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.229+0000 7f8786000640 1 -- 172.21.15.100:0/2177281413 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f87880996c0 con 0x7f879015c750 2024-09-10T21:06:48.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.230+0000 7f878de00640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8770077f70 0x7f877007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:48.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.230+0000 7f878de00640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8770077f70 0x7f877007a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8780005fd0 tx=0x7f8780009700 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:48.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.233+0000 7f8786000640 1 -- 172.21.15.100:0/2177281413 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f87880616e0 con 0x7f879015c750 2024-09-10T21:06:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.415+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f87900cc490 con 0x7f879015c750 2024-09-10T21:06:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.416+0000 7f8786000640 1 -- 172.21.15.100:0/2177281413 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f8788066110 con 0x7f879015c750 2024-09-10T21:06:48.419 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-09-10T21:06:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8770077f70 msgr2=0x7f877007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8770077f70 0x7f877007a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8780005fd0 tx=0x7f8780009700 comp rx=0 tx=0).stop 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f879015c750 msgr2=0x7f8790155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f879015c750 0x7f8790155cf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f878800c3c0 tx=0x7f878800c880 comp rx=0 tx=0).stop 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 shutdown_connections 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f879015c750 0x7f8790155cf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f879015b680 0x7f879014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8770077f70 0x7f877007a430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 --2- 172.21.15.100:0/2177281413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87900741e0 0x7f87900af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 >> 172.21.15.100:0/2177281413 conn(0x7f879006cb50 msgr2=0x7f87900b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 shutdown_connections 2024-09-10T21:06:48.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.418+0000 7f8795200640 1 -- 172.21.15.100:0/2177281413 wait complete. 2024-09-10T21:06:48.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_readahead.TestReadahead.test_flush' 2024-09-10T21:06:48.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.592+0000 7efc53800640 1 -- 172.21.15.100:0/2931265473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc30004800 msgr2=0x7efc30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.592+0000 7efc53800640 1 --2- 172.21.15.100:0/2931265473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc30004800 0x7efc30004c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0d0380 tx=0x7efc30005830 comp rx=0 tx=0).stop 2024-09-10T21:06:48.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.592+0000 7efc51800640 1 -- 172.21.15.100:0/2931265473 reap_dead start 2024-09-10T21:06:48.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.592+0000 7efc53800640 1 -- 172.21.15.100:0/2931265473 shutdown_connections 2024-09-10T21:06:48.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.592+0000 7efc53800640 1 -- 172.21.15.100:0/2931265473 >> 172.21.15.100:0/2931265473 conn(0x7efc4c06cb50 msgr2=0x7efc4c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:48.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.592+0000 7efc53800640 1 -- 172.21.15.100:0/2931265473 shutdown_connections 2024-09-10T21:06:48.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.592+0000 7efc53800640 1 -- 172.21.15.100:0/2931265473 wait complete. 2024-09-10T21:06:48.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.594+0000 7efc53800640 1 Processor -- start 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.594+0000 7efc53800640 1 -- start start 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc53800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc30004800 0x7efc4c147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc53800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc4c153d50 0x7efc4c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc53800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc4c0b0bd0 0x7efc4c0b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc53800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c06f150 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc53800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c06efd0 con 0x7efc4c153d50 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc53800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7efc4c06f2d0 con 0x7efc30004800 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc51800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc4c0b0bd0 0x7efc4c0b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc51800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc4c0b0bd0 0x7efc4c0b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40156/0 (socket says 172.21.15.100:40156) 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc51800640 1 -- 172.21.15.100:0/3552218916 learned_addr learned my addr 172.21.15.100:0/3552218916 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc50e00640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc30004800 0x7efc4c147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:48.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.595+0000 7efc4be00640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc4c153d50 0x7efc4c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc51800640 1 -- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc30004800 msgr2=0x7efc4c147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc51800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc30004800 0x7efc4c147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc51800640 1 -- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc4c153d50 msgr2=0x7efc4c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc51800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc4c153d50 0x7efc4c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc51800640 1 -- 172.21.15.100:0/3552218916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c0af5f0 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc51800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc4c0b0bd0 0x7efc4c0b1990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc30004780 tx=0x7efc44006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc48c00640 1 -- 172.21.15.100:0/3552218916 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc44015020 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc48c00640 1 -- 172.21.15.100:0/3552218916 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc440109a0 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4c0af8d0 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc48c00640 1 -- 172.21.15.100:0/3552218916 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc44010df0 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.596+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4c0afe90 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.597+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4c0b3290 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.598+0000 7efc48c00640 1 -- 172.21.15.100:0/3552218916 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efc440193b0 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.599+0000 7efc48c00640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efc2c077f70 0x7efc2c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:48.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.599+0000 7efc48c00640 1 -- 172.21.15.100:0/3552218916 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7efc4409acf0 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.600+0000 7efc50e00640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efc2c077f70 0x7efc2c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:48.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.600+0000 7efc50e00640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efc2c077f70 0x7efc2c07a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009c50 tx=0x7efc3c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:48.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.603+0000 7efc48c00640 1 -- 172.21.15.100:0/3552218916 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efc4401f030 con 0x7efc4c0b0bd0 2024-09-10T21:06:48.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:48.855+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_readahead.TestReadahead.test_flush"]} v 0) -- 0x7efc4c15cc70 con 0x7efc4c0b0bd0 2024-09-10T21:06:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.746+0000 7efc48c00640 1 -- 172.21.15.100:0/3552218916 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_readahead.TestReadahead.test_flush"]}]=0 v62) ==== 134+0+0 (secure 0 0 0) 0x7efc4409a070 con 0x7efc4c0b0bd0 2024-09-10T21:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efc2c077f70 msgr2=0x7efc2c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efc2c077f70 0x7efc2c07a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009c50 tx=0x7efc3c005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc4c0b0bd0 msgr2=0x7efc4c0b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc4c0b0bd0 0x7efc4c0b1990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc30004780 tx=0x7efc44006420 comp rx=0 tx=0).stop 2024-09-10T21:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 shutdown_connections 2024-09-10T21:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc4c0b0bd0 0x7efc4c0b1990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7efc2c077f70 0x7efc2c07a430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:49.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc4c153d50 0x7efc4c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 --2- 172.21.15.100:0/3552218916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc30004800 0x7efc4c147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 >> 172.21.15.100:0/3552218916 conn(0x7efc4c06cb50 msgr2=0x7efc4c15d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.749+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 shutdown_connections 2024-09-10T21:06:49.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.750+0000 7efc53800640 1 -- 172.21.15.100:0/3552218916 wait complete. 2024-09-10T21:06:49.771 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T21:06:49.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.928+0000 7f25b6200640 1 -- 172.21.15.100:0/2050043865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 msgr2=0x7f2594004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:49.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.928+0000 7f25b6200640 1 --2- 172.21.15.100:0/2050043865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 0x7f2594004c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f259c009b50 tx=0x7f2594005830 comp rx=0 tx=0).stop 2024-09-10T21:06:49.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.929+0000 7f25b6200640 1 -- 172.21.15.100:0/2050043865 shutdown_connections 2024-09-10T21:06:49.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.929+0000 7f25b6200640 1 --2- 172.21.15.100:0/2050043865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 0x7f2594004c80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:49.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.929+0000 7f25b6200640 1 -- 172.21.15.100:0/2050043865 >> 172.21.15.100:0/2050043865 conn(0x7f25b006d500 msgr2=0x7f25b00b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:49.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.929+0000 7f25b6200640 1 -- 172.21.15.100:0/2050043865 shutdown_connections 2024-09-10T21:06:49.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.929+0000 7f25b6200640 1 -- 172.21.15.100:0/2050043865 wait complete. 2024-09-10T21:06:49.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.930+0000 7f25b6200640 1 Processor -- start 2024-09-10T21:06:49.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.930+0000 7f25b6200640 1 -- start start 2024-09-10T21:06:49.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.931+0000 7f25b6200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 0x7f25b00c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:49.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.931+0000 7f25b6200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b01511e0 0x7f25b01448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.931+0000 7f25b6200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25b00b04f0 0x7f25b00b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.931+0000 7f25b6200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25b015c060 con 0x7f2594004800 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.931+0000 7f25b6200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25b015bee0 con 0x7f25b01511e0 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.931+0000 7f25b6200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f25b00cec80 con 0x7f25b00b04f0 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 0x7f25b00c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 0x7f25b00c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40172/0 (socket says 172.21.15.100:40172) 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 -- 172.21.15.100:0/2300115335 learned_addr learned my addr 172.21.15.100:0/2300115335 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25afe00640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b01511e0 0x7f25b01448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b5800640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25b00b04f0 0x7f25b00b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:49.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 -- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25b00b04f0 msgr2=0x7f25b00b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25b00b04f0 0x7f25b00b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 -- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b01511e0 msgr2=0x7f25b01448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b01511e0 0x7f25b01448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 -- 172.21.15.100:0/2300115335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b0144e20 con 0x7f2594004800 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b5800640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25b00b04f0 0x7f25b00b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25b4e00640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 0x7f25b00c4660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f25a0003ea0 tx=0x7f25a0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.932+0000 7f25acc00640 1 -- 172.21.15.100:0/2300115335 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0015070 con 0x7f2594004800 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.933+0000 7f25acc00640 1 -- 172.21.15.100:0/2300115335 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25a0001d30 con 0x7f2594004800 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.933+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b00af450 con 0x7f2594004800 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.933+0000 7f25acc00640 1 -- 172.21.15.100:0/2300115335 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0011ac0 con 0x7f2594004800 2024-09-10T21:06:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.933+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b00afa10 con 0x7f2594004800 2024-09-10T21:06:49.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.934+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b00cf1e0 con 0x7f2594004800 2024-09-10T21:06:49.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.935+0000 7f25acc00640 1 -- 172.21.15.100:0/2300115335 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f25a0011c60 con 0x7f2594004800 2024-09-10T21:06:49.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.936+0000 7f25acc00640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2590077fa0 0x7f259007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:49.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.936+0000 7f25acc00640 1 -- 172.21.15.100:0/2300115335 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f25a009ae30 con 0x7f2594004800 2024-09-10T21:06:49.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.936+0000 7f25afe00640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2590077fa0 0x7f259007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:49.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.937+0000 7f25afe00640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2590077fa0 0x7f259007a460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f259c035000 tx=0x7f259c0046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:49.940+0000 7f25acc00640 1 -- 172.21.15.100:0/2300115335 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f25a0062ee0 con 0x7f2594004800 2024-09-10T21:06:50.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.123+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f25b00cd750 con 0x7f2594004800 2024-09-10T21:06:50.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.123+0000 7f25acc00640 1 -- 172.21.15.100:0/2300115335 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f25a0067910 con 0x7f2594004800 2024-09-10T21:06:50.127 INFO:teuthology.orchestra.run.smithi100.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T21:06:50.127 INFO:teuthology.orchestra.run.smithi100.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T21:06:50.127 INFO:teuthology.orchestra.run.smithi100.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T21:06:50.127 INFO:teuthology.orchestra.run.smithi100.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T21:06:50.127 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3572.669398 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3620.907663 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3913.694821 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3793.780435 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4727.247003 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7895.855352 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4234.029972 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4433.691141 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:mds advanced debug_mds 20/20 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:mds advanced debug_ms 2/2 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:mds dev mds_debug_frag true 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:mds dev mds_debug_scatterstat true 2024-09-10T21:06:50.128 INFO:teuthology.orchestra.run.smithi100.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:mds dev mds_verify_scatter true 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:client advanced client_mount_timeout 600 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:client advanced debug_client 20/20 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:client advanced debug_ms 1/1 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T21:06:50.129 INFO:teuthology.orchestra.run.smithi100.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T21:06:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2590077fa0 msgr2=0x7f259007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2590077fa0 0x7f259007a460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f259c035000 tx=0x7f259c0046c0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 msgr2=0x7f25b00c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 0x7f25b00c4660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f25a0003ea0 tx=0x7f25a0003f90 comp rx=0 tx=0).stop 2024-09-10T21:06:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 shutdown_connections 2024-09-10T21:06:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25b00b04f0 0x7f25b00b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2590077fa0 0x7f259007a460 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b01511e0 0x7f25b01448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 --2- 172.21.15.100:0/2300115335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594004800 0x7f25b00c4660 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 >> 172.21.15.100:0/2300115335 conn(0x7f25b006d500 msgr2=0x7f25b006f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 shutdown_connections 2024-09-10T21:06:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.126+0000 7f25b6200640 1 -- 172.21.15.100:0/2300115335 wait complete. 2024-09-10T21:06:50.146 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T21:06:50.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.302+0000 7f15aac00640 1 -- 172.21.15.100:0/570036867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a4073b80 msgr2=0x7f15a4073fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:50.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.302+0000 7f15aac00640 1 --2- 172.21.15.100:0/570036867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a4073b80 0x7f15a4073fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f15a40d0410 tx=0x7f159c02a4d0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.302+0000 7f15aac00640 1 -- 172.21.15.100:0/570036867 shutdown_connections 2024-09-10T21:06:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.302+0000 7f15aac00640 1 --2- 172.21.15.100:0/570036867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a4073b80 0x7f15a4073fa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.302+0000 7f15aac00640 1 --2- 172.21.15.100:0/570036867 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a415d620 0x7f15a4153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.302+0000 7f15aac00640 1 --2- 172.21.15.100:0/570036867 >> v2:172.21.15.130:3300/0 conn(0x7f15a4070540 0x7f15a40b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.302+0000 7f15aac00640 1 -- 172.21.15.100:0/570036867 >> 172.21.15.100:0/570036867 conn(0x7f15a406cb50 msgr2=0x7f15a406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.302+0000 7f15aac00640 1 -- 172.21.15.100:0/570036867 shutdown_connections 2024-09-10T21:06:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.303+0000 7f15aac00640 1 -- 172.21.15.100:0/570036867 wait complete. 2024-09-10T21:06:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.304+0000 7f15aac00640 1 Processor -- start 2024-09-10T21:06:50.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.304+0000 7f15aac00640 1 -- start start 2024-09-10T21:06:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.305+0000 7f15aac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a4070540 0x7f15a4147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.305+0000 7f15aac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a4073b80 0x7f15a4148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.305+0000 7f15aac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a415d620 0x7f15a4136910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.305+0000 7f15aac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15a415aba0 con 0x7f15a415d620 2024-09-10T21:06:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.305+0000 7f15aac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15a415aa20 con 0x7f15a4073b80 2024-09-10T21:06:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.305+0000 7f15aac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f15a415ad20 con 0x7f15a4070540 2024-09-10T21:06:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.305+0000 7f15a8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a415d620 0x7f15a4136910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a415d620 0x7f15a4136910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40182/0 (socket says 172.21.15.100:40182) 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a8c00640 1 -- 172.21.15.100:0/850267827 learned_addr learned my addr 172.21.15.100:0/850267827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a3e00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a4070540 0x7f15a4147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a3400640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a4073b80 0x7f15a4148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a8c00640 1 -- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a4070540 msgr2=0x7f15a4147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a8c00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a4070540 0x7f15a4147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a8c00640 1 -- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a4073b80 msgr2=0x7f15a4148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a8c00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a4073b80 0x7f15a4148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a8c00640 1 -- 172.21.15.100:0/850267827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a4154720 con 0x7f15a415d620 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a3400640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a4073b80 0x7f15a4148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a3e00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a4070540 0x7f15a4147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15a8c00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a415d620 0x7f15a4136910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f159c009230 tx=0x7f159c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f159be00640 1 -- 172.21.15.100:0/850267827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c03f070 con 0x7f15a415d620 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f159be00640 1 -- 172.21.15.100:0/850267827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f159c0047a0 con 0x7f15a415d620 2024-09-10T21:06:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f159be00640 1 -- 172.21.15.100:0/850267827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c035030 con 0x7f15a415d620 2024-09-10T21:06:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.306+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a4154a00 con 0x7f15a415d620 2024-09-10T21:06:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.307+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a4134990 con 0x7f15a415d620 2024-09-10T21:06:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.308+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a4073fa0 con 0x7f15a415d620 2024-09-10T21:06:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.309+0000 7f159be00640 1 -- 172.21.15.100:0/850267827 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f159c004bf0 con 0x7f15a415d620 2024-09-10T21:06:50.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.309+0000 7f159be00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1584077f70 0x7f158407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:50.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.310+0000 7f159be00640 1 -- 172.21.15.100:0/850267827 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f159c0bb190 con 0x7f15a415d620 2024-09-10T21:06:50.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.310+0000 7f15a3e00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1584077f70 0x7f158407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:50.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.311+0000 7f15a3e00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1584077f70 0x7f158407a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1594005fd0 tx=0x7f1594009500 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:50.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.313+0000 7f159be00640 1 -- 172.21.15.100:0/850267827 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f159c083890 con 0x7f15a415d620 2024-09-10T21:06:50.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.497+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f15a414fbf0 con 0x7f15a415d620 2024-09-10T21:06:50.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.502+0000 7f159be00640 1 -- 172.21.15.100:0/850267827 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f159c083190 con 0x7f15a415d620 2024-09-10T21:06:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1584077f70 msgr2=0x7f158407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1584077f70 0x7f158407a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1594005fd0 tx=0x7f1594009500 comp rx=0 tx=0).stop 2024-09-10T21:06:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a415d620 msgr2=0x7f15a4136910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a415d620 0x7f15a4136910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f159c009230 tx=0x7f159c003820 comp rx=0 tx=0).stop 2024-09-10T21:06:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 shutdown_connections 2024-09-10T21:06:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a415d620 0x7f15a4136910 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1584077f70 0x7f158407a430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a4073b80 0x7f15a4148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 --2- 172.21.15.100:0/850267827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a4070540 0x7f15a4147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 >> 172.21.15.100:0/850267827 conn(0x7f15a406cb50 msgr2=0x7f15a415b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 shutdown_connections 2024-09-10T21:06:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:50.504+0000 7f15aac00640 1 -- 172.21.15.100:0/850267827 wait complete. 2024-09-10T21:06:50.524 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T21:06:50.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T21:06:50.602 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T21:06:50.705 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T21:06:50.705 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:06:50.705 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:50.740 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:06:50.740 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:50.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:51.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.012+0000 7f2dbde00640 1 -- 172.21.15.100:0/1897557602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 msgr2=0x7f2db815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.012+0000 7f2dbde00640 1 --2- 172.21.15.100:0/1897557602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 0x7f2db815bef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009830 tx=0x7f2da402a510 comp rx=0 tx=0).stop 2024-09-10T21:06:51.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.012+0000 7f2dbde00640 1 -- 172.21.15.100:0/1897557602 shutdown_connections 2024-09-10T21:06:51.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.012+0000 7f2dbde00640 1 --2- 172.21.15.100:0/1897557602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 0x7f2db815bef0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.012+0000 7f2dbde00640 1 -- 172.21.15.100:0/1897557602 >> 172.21.15.100:0/1897557602 conn(0x7f2db806cb50 msgr2=0x7f2db806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:51.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.012+0000 7f2dbde00640 1 -- 172.21.15.100:0/1897557602 shutdown_connections 2024-09-10T21:06:51.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.012+0000 7f2dbde00640 1 -- 172.21.15.100:0/1897557602 wait complete. 2024-09-10T21:06:51.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.014+0000 7f2dbde00640 1 Processor -- start 2024-09-10T21:06:51.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.014+0000 7f2dbde00640 1 -- start start 2024-09-10T21:06:51.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2dbde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 0x7f2db81482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:51.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2dbde00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2db8154cf0 0x7f2db80b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:51.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2dbde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db815ae80 0x7f2db81f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:51.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2dbde00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2db806fc40 con 0x7f2db8073c70 2024-09-10T21:06:51.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2dbde00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2db806fac0 con 0x7f2db815ae80 2024-09-10T21:06:51.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2dbde00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2db806fdc0 con 0x7f2db8154cf0 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2db6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 0x7f2db81482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2db6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 0x7f2db81482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40190/0 (socket says 172.21.15.100:40190) 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2db6a00640 1 -- 172.21.15.100:0/1951557548 learned_addr learned my addr 172.21.15.100:0/1951557548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2db6000640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2db8154cf0 0x7f2db80b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.015+0000 7f2db7400640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db815ae80 0x7f2db81f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2db6a00640 1 -- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2db8154cf0 msgr2=0x7f2db80b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2db6a00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2db8154cf0 0x7f2db80b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2db6a00640 1 -- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db815ae80 msgr2=0x7f2db81f8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2db6a00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db815ae80 0x7f2db81f8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2db6a00640 1 -- 172.21.15.100:0/1951557548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db81f8af0 con 0x7f2db8073c70 2024-09-10T21:06:51.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2db7400640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db815ae80 0x7f2db81f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:51.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2db6a00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 0x7f2db81482f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c450 tx=0x7f2da800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:51.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2daf400640 1 -- 172.21.15.100:0/1951557548 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8016020 con 0x7f2db8073c70 2024-09-10T21:06:51.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2daf400640 1 -- 172.21.15.100:0/1951557548 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2da8012920 con 0x7f2db8073c70 2024-09-10T21:06:51.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db81f8dd0 con 0x7f2db8073c70 2024-09-10T21:06:51.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2daf400640 1 -- 172.21.15.100:0/1951557548 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8012d70 con 0x7f2db8073c70 2024-09-10T21:06:51.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.016+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db8148830 con 0x7f2db8073c70 2024-09-10T21:06:51.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.017+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db806c700 con 0x7f2db8073c70 2024-09-10T21:06:51.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.019+0000 7f2daf400640 1 -- 172.21.15.100:0/1951557548 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2da801b400 con 0x7f2db8073c70 2024-09-10T21:06:51.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.019+0000 7f2daf400640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2d98077f70 0x7f2d9807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:51.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.020+0000 7f2daf400640 1 -- 172.21.15.100:0/1951557548 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f2da809a410 con 0x7f2db8073c70 2024-09-10T21:06:51.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.020+0000 7f2db6000640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2d98077f70 0x7f2d9807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:51.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.020+0000 7f2db6000640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2d98077f70 0x7f2d9807a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2da4034000 tx=0x7f2da4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:51.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.023+0000 7f2daf400640 1 -- 172.21.15.100:0/1951557548 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2db806c700 con 0x7f2db8073c70 2024-09-10T21:06:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.217+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2db8070260 con 0x7f2db8073c70 2024-09-10T21:06:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.217+0000 7f2daf400640 1 -- 172.21.15.100:0/1951557548 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f2da8020020 con 0x7f2db8073c70 2024-09-10T21:06:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.219+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2d98077f70 msgr2=0x7f2d9807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.219+0000 7f2dbde00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2d98077f70 0x7f2d9807a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2da4034000 tx=0x7f2da4004730 comp rx=0 tx=0).stop 2024-09-10T21:06:51.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.219+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 msgr2=0x7f2db81482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.219+0000 7f2dbde00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 0x7f2db81482f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c450 tx=0x7f2da800c910 comp rx=0 tx=0).stop 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.220+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 shutdown_connections 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.220+0000 7f2dbde00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2d98077f70 0x7f2d9807a430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.220+0000 7f2dbde00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2db815ae80 0x7f2db81f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.220+0000 7f2dbde00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2db8154cf0 0x7f2db80b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.220+0000 7f2dbde00640 1 --2- 172.21.15.100:0/1951557548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2db8073c70 0x7f2db81482f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.220+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 >> 172.21.15.100:0/1951557548 conn(0x7f2db806cb50 msgr2=0x7f2db80cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.220+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 shutdown_connections 2024-09-10T21:06:51.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.220+0000 7f2dbde00640 1 -- 172.21.15.100:0/1951557548 wait complete. 2024-09-10T21:06:51.239 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:06:51.239 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:51.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.467+0000 7fc796400640 1 -- 172.21.15.100:0/2832645601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 msgr2=0x7fc79015ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.467+0000 7fc796400640 1 --2- 172.21.15.100:0/2832645601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 0x7fc79015ea60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc780005fd0 tx=0x7fc78002ab20 comp rx=0 tx=0).stop 2024-09-10T21:06:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.467+0000 7fc796400640 1 -- 172.21.15.100:0/2832645601 shutdown_connections 2024-09-10T21:06:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.467+0000 7fc796400640 1 --2- 172.21.15.100:0/2832645601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7900cf810 0x7fc790161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.467+0000 7fc796400640 1 --2- 172.21.15.100:0/2832645601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 0x7fc79015ea60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.467+0000 7fc796400640 1 -- 172.21.15.100:0/2832645601 >> 172.21.15.100:0/2832645601 conn(0x7fc79006cb50 msgr2=0x7fc79006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.467+0000 7fc796400640 1 -- 172.21.15.100:0/2832645601 shutdown_connections 2024-09-10T21:06:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.467+0000 7fc796400640 1 -- 172.21.15.100:0/2832645601 wait complete. 2024-09-10T21:06:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.469+0000 7fc796400640 1 Processor -- start 2024-09-10T21:06:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.469+0000 7fc796400640 1 -- start start 2024-09-10T21:06:51.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc796400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc79006eb60 0x7fc7900c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:51.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc796400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7900cf810 0x7fc790159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:51.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc796400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 0x7fc7900b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:51.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc796400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc79006f380 con 0x7fc79015b4d0 2024-09-10T21:06:51.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc796400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc79006f200 con 0x7fc7900cf810 2024-09-10T21:06:51.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc796400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc7900c9410 con 0x7fc79006eb60 2024-09-10T21:06:51.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc78fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 0x7fc7900b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:51.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc78fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 0x7fc7900b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40198/0 (socket says 172.21.15.100:40198) 2024-09-10T21:06:51.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc78fe00640 1 -- 172.21.15.100:0/3690904379 learned_addr learned my addr 172.21.15.100:0/3690904379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:51.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc78f400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc79006eb60 0x7fc7900c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:51.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.470+0000 7fc78ea00640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7900cf810 0x7fc790159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc78fe00640 1 -- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc79006eb60 msgr2=0x7fc7900c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc78fe00640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc79006eb60 0x7fc7900c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc78fe00640 1 -- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7900cf810 msgr2=0x7fc790159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc78fe00640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7900cf810 0x7fc790159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc78fe00640 1 -- 172.21.15.100:0/3690904379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7901f4dd0 con 0x7fc79015b4d0 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc78fe00640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 0x7fc7900b14f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c400 tx=0x7fc78800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc787400640 1 -- 172.21.15.100:0/3690904379 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788017070 con 0x7fc79015b4d0 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc787400640 1 -- 172.21.15.100:0/3690904379 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7880053c0 con 0x7fc79015b4d0 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc787400640 1 -- 172.21.15.100:0/3690904379 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788003850 con 0x7fc79015b4d0 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7900c83f0 con 0x7fc79015b4d0 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.471+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7900c89b0 con 0x7fc79015b4d0 2024-09-10T21:06:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.472+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7900c8bb0 con 0x7fc79015b4d0 2024-09-10T21:06:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.474+0000 7fc787400640 1 -- 172.21.15.100:0/3690904379 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc7880039f0 con 0x7fc79015b4d0 2024-09-10T21:06:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.475+0000 7fc787400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.475+0000 7fc787400640 1 -- 172.21.15.100:0/3690904379 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fc788099ba0 con 0x7fc79015b4d0 2024-09-10T21:06:51.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.475+0000 7fc78f400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:51.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.476+0000 7fc78f400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc770077f70 0x7fc77007a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc780035000 tx=0x7fc780038040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:51.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.477+0000 7fc787400640 1 -- 172.21.15.100:0/3690904379 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc788099e20 con 0x7fc79015b4d0 2024-09-10T21:06:51.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.672+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc7900b34f0 con 0x7fc79015b4d0 2024-09-10T21:06:51.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.673+0000 7fc787400640 1 -- 172.21.15.100:0/3690904379 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fc7900c8bb0 con 0x7fc79015b4d0 2024-09-10T21:06:51.676 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc770077f70 msgr2=0x7fc77007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc770077f70 0x7fc77007a430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc780035000 tx=0x7fc780038040 comp rx=0 tx=0).stop 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 msgr2=0x7fc7900b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 0x7fc7900b14f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c400 tx=0x7fc78800c8c0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 shutdown_connections 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc79015b4d0 0x7fc7900b14f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc770077f70 0x7fc77007a430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7900cf810 0x7fc790159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 --2- 172.21.15.100:0/3690904379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc79006eb60 0x7fc7900c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 >> 172.21.15.100:0/3690904379 conn(0x7fc79006cb50 msgr2=0x7fc7900b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:51.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 shutdown_connections 2024-09-10T21:06:51.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:51.675+0000 7fc796400640 1 -- 172.21.15.100:0/3690904379 wait complete. 2024-09-10T21:06:51.694 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-09-10T21:06:51.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:51.694 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T21:06:51.749 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:06:51.750 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:06:51.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:51.750 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T21:06:51.788 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:06:51.788 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:51.825 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:06:51.825 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:51.901 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.055+0000 7f8f3ee00640 1 -- 172.21.15.100:0/1292885903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 msgr2=0x7f8f3815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.055+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/1292885903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 0x7f8f3815ba60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8f38074660 tx=0x7f8f2802aa30 comp rx=0 tx=0).stop 2024-09-10T21:06:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.055+0000 7f8f3ee00640 1 -- 172.21.15.100:0/1292885903 shutdown_connections 2024-09-10T21:06:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.055+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/1292885903 >> v2:172.21.15.130:3300/0 conn(0x7f8f380741e0 0x7f8f3815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.055+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/1292885903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 0x7f8f3815ba60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.055+0000 7f8f3ee00640 1 -- 172.21.15.100:0/1292885903 >> 172.21.15.100:0/1292885903 conn(0x7f8f3806cb50 msgr2=0x7f8f3806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.055+0000 7f8f3ee00640 1 -- 172.21.15.100:0/1292885903 shutdown_connections 2024-09-10T21:06:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.055+0000 7f8f3ee00640 1 -- 172.21.15.100:0/1292885903 wait complete. 2024-09-10T21:06:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.057+0000 7f8f3ee00640 1 Processor -- start 2024-09-10T21:06:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.057+0000 7f8f3ee00640 1 -- start start 2024-09-10T21:06:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f3ee00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f380741e0 0x7f8f381f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f3ee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 0x7f8f38153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f3ee00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3815c750 0x7f8f38159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f3ee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f380b2860 con 0x7f8f3815b680 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f3ee00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3815cf00 con 0x7f8f380741e0 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f3ee00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8f380b29e0 con 0x7f8f3815c750 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 0x7f8f38153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 0x7f8f38153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53834/0 (socket says 172.21.15.100:53834) 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37400640 1 -- 172.21.15.100:0/2117575510 learned_addr learned my addr 172.21.15.100:0/2117575510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37e00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f380741e0 0x7f8f381f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f3ce00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3815c750 0x7f8f38159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37400640 1 -- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3815c750 msgr2=0x7f8f38159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37400640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3815c750 0x7f8f38159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37400640 1 -- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f380741e0 msgr2=0x7f8f381f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37400640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f380741e0 0x7f8f381f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.058+0000 7f8f37400640 1 -- 172.21.15.100:0/2117575510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f381f3b30 con 0x7f8f3815b680 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.059+0000 7f8f37400640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 0x7f8f38153a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400b4a0 tx=0x7f8f2400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.059+0000 7f8f2fe00640 1 -- 172.21.15.100:0/2117575510 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24014070 con 0x7f8f3815b680 2024-09-10T21:06:52.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.059+0000 7f8f2fe00640 1 -- 172.21.15.100:0/2117575510 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f24010700 con 0x7f8f3815b680 2024-09-10T21:06:52.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.059+0000 7f8f2fe00640 1 -- 172.21.15.100:0/2117575510 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24010b50 con 0x7f8f3815b680 2024-09-10T21:06:52.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.059+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f381f2fb0 con 0x7f8f3815b680 2024-09-10T21:06:52.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.059+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f381f3570 con 0x7f8f3815b680 2024-09-10T21:06:52.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.060+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f380b2f10 con 0x7f8f3815b680 2024-09-10T21:06:52.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.061+0000 7f8f2fe00640 1 -- 172.21.15.100:0/2117575510 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8f24017360 con 0x7f8f3815b680 2024-09-10T21:06:52.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.062+0000 7f8f2fe00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8f18077fa0 0x7f8f1807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:52.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.062+0000 7f8f2fe00640 1 -- 172.21.15.100:0/2117575510 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f8f24099e10 con 0x7f8f3815b680 2024-09-10T21:06:52.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.063+0000 7f8f37e00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8f18077fa0 0x7f8f1807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.063+0000 7f8f37e00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8f18077fa0 0x7f8f1807a460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8f28035000 tx=0x7f8f2803a040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.066+0000 7f8f2fe00640 1 -- 172.21.15.100:0/2117575510 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8f2409d030 con 0x7f8f3815b680 2024-09-10T21:06:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.262+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8f380cf040 con 0x7f8f3815b680 2024-09-10T21:06:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.263+0000 7f8f2fe00640 1 -- 172.21.15.100:0/2117575510 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f8f24061e30 con 0x7f8f3815b680 2024-09-10T21:06:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:52.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8f18077fa0 msgr2=0x7f8f1807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8f18077fa0 0x7f8f1807a460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8f28035000 tx=0x7f8f2803a040 comp rx=0 tx=0).stop 2024-09-10T21:06:52.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 msgr2=0x7f8f38153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 0x7f8f38153a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400b4a0 tx=0x7f8f2400b960 comp rx=0 tx=0).stop 2024-09-10T21:06:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 shutdown_connections 2024-09-10T21:06:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f3815c750 0x7f8f38159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3815b680 0x7f8f38153a30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8f18077fa0 0x7f8f1807a460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 --2- 172.21.15.100:0/2117575510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f380741e0 0x7f8f381f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 >> 172.21.15.100:0/2117575510 conn(0x7f8f3806cb50 msgr2=0x7f8f380b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.265+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 shutdown_connections 2024-09-10T21:06:52.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.266+0000 7f8f3ee00640 1 -- 172.21.15.100:0/2117575510 wait complete. 2024-09-10T21:06:52.284 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:06:52.285 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:52.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.474+0000 7fc5fb200640 1 -- 172.21.15.100:0/273986632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5fc074280 msgr2=0x7fc5fc0ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.474+0000 7fc5fb200640 1 --2- 172.21.15.100:0/273986632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5fc074280 0x7fc5fc0ae490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4005fd0 tx=0x7fc5f402aa10 comp rx=0 tx=0).stop 2024-09-10T21:06:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.474+0000 7fc5fb200640 1 -- 172.21.15.100:0/273986632 shutdown_connections 2024-09-10T21:06:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.474+0000 7fc5fb200640 1 --2- 172.21.15.100:0/273986632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5fc074280 0x7fc5fc0ae490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.474+0000 7fc5fb200640 1 --2- 172.21.15.100:0/273986632 >> v2:172.21.15.130:3300/0 conn(0x7fc5fc155df0 0x7fc5fc0730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.474+0000 7fc5fb200640 1 -- 172.21.15.100:0/273986632 >> 172.21.15.100:0/273986632 conn(0x7fc5fc0b1480 msgr2=0x7fc5fc0b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.474+0000 7fc5fb200640 1 -- 172.21.15.100:0/273986632 shutdown_connections 2024-09-10T21:06:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.474+0000 7fc5fb200640 1 -- 172.21.15.100:0/273986632 wait complete. 2024-09-10T21:06:52.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.475+0000 7fc5fb200640 1 Processor -- start 2024-09-10T21:06:52.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.476+0000 7fc5fb200640 1 -- start start 2024-09-10T21:06:52.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.476+0000 7fc5fb200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5fc074280 0x7fc5fc151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:52.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5fb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5fc155df0 0x7fc5fc0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5fb200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5fc15c6c0 0x7fc5fc13ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5fb200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc0b2310 con 0x7fc5fc155df0 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5fb200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc0cbf60 con 0x7fc5fc15c6c0 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5fb200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc5fc0ae9d0 con 0x7fc5fc074280 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5fc155df0 0x7fc5fc0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5fa800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5fc15c6c0 0x7fc5fc13ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5fc155df0 0x7fc5fc0adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53842/0 (socket says 172.21.15.100:53842) 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9400640 1 -- 172.21.15.100:0/3349566220 learned_addr learned my addr 172.21.15.100:0/3349566220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9e00640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5fc074280 0x7fc5fc151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9400640 1 -- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5fc074280 msgr2=0x7fc5fc151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9400640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5fc074280 0x7fc5fc151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9400640 1 -- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5fc15c6c0 msgr2=0x7fc5fc13ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9400640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5fc15c6c0 0x7fc5fc13ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.477+0000 7fc5f9400640 1 -- 172.21.15.100:0/3349566220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5fc150540 con 0x7fc5fc155df0 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.478+0000 7fc5f9400640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5fc155df0 0x7fc5fc0adac0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c3a0 tx=0x7fc5e800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.478+0000 7fc5f2000640 1 -- 172.21.15.100:0/3349566220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8017070 con 0x7fc5fc155df0 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.478+0000 7fc5f2000640 1 -- 172.21.15.100:0/3349566220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5e80053c0 con 0x7fc5fc155df0 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.478+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5fc150820 con 0x7fc5fc155df0 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.478+0000 7fc5f2000640 1 -- 172.21.15.100:0/3349566220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8003850 con 0x7fc5fc155df0 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.478+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5fc150de0 con 0x7fc5fc155df0 2024-09-10T21:06:52.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.479+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5fc0aeef0 con 0x7fc5fc155df0 2024-09-10T21:06:52.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.480+0000 7fc5f2000640 1 -- 172.21.15.100:0/3349566220 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc5e80039f0 con 0x7fc5fc155df0 2024-09-10T21:06:52.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.482+0000 7fc5f2000640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5dc077f70 0x7fc5dc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:52.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.482+0000 7fc5f2000640 1 -- 172.21.15.100:0/3349566220 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fc5e8099780 con 0x7fc5fc155df0 2024-09-10T21:06:52.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.483+0000 7fc5f9e00640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5dc077f70 0x7fc5dc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:52.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.483+0000 7fc5f9e00640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5dc077f70 0x7fc5dc07a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009bd0 tx=0x7fc5ec005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:52.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.486+0000 7fc5f2000640 1 -- 172.21.15.100:0/3349566220 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc5e80617a0 con 0x7fc5fc155df0 2024-09-10T21:06:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.680+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc5fc0b3d10 con 0x7fc5fc155df0 2024-09-10T21:06:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.681+0000 7fc5f2000640 1 -- 172.21.15.100:0/3349566220 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fc5e80661d0 con 0x7fc5fc155df0 2024-09-10T21:06:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5dc077f70 msgr2=0x7fc5dc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5dc077f70 0x7fc5dc07a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009bd0 tx=0x7fc5ec005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5fc155df0 msgr2=0x7fc5fc0adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5fc155df0 0x7fc5fc0adac0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c3a0 tx=0x7fc5e800c860 comp rx=0 tx=0).stop 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 shutdown_connections 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5dc077f70 0x7fc5dc07a430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5fc15c6c0 0x7fc5fc13ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5fc155df0 0x7fc5fc0adac0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 --2- 172.21.15.100:0/3349566220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5fc074280 0x7fc5fc151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 >> 172.21.15.100:0/3349566220 conn(0x7fc5fc0b1480 msgr2=0x7fc5fc0ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 shutdown_connections 2024-09-10T21:06:52.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:52.683+0000 7fc5fb200640 1 -- 172.21.15.100:0/3349566220 wait complete. 2024-09-10T21:06:52.702 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi130.front.sepia.ceph.com... 2024-09-10T21:06:52.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:52.703 DEBUG:teuthology.orchestra.run.smithi130:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-10T21:06:52.762 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:06:52.762 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:06:52.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:52.762 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T21:06:52.824 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:06:52.824 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:52.859 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:06:52.859 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:52.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:53.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.130+0000 7f0264c00640 1 -- 172.21.15.100:0/2398391726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 msgr2=0x7f026015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.130+0000 7f0264c00640 1 --2- 172.21.15.100:0/2398391726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 0x7f026015f4d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f024c005fd0 tx=0x7f024c02a5d0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.130+0000 7f0264c00640 1 -- 172.21.15.100:0/2398391726 shutdown_connections 2024-09-10T21:06:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.130+0000 7f0264c00640 1 --2- 172.21.15.100:0/2398391726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c750 0x7f02600cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.130+0000 7f0264c00640 1 --2- 172.21.15.100:0/2398391726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02600741e0 0x7f026015f4d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.130+0000 7f0264c00640 1 -- 172.21.15.100:0/2398391726 >> 172.21.15.100:0/2398391726 conn(0x7f026006cb50 msgr2=0x7f026006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.130+0000 7f0264c00640 1 -- 172.21.15.100:0/2398391726 shutdown_connections 2024-09-10T21:06:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.130+0000 7f0264c00640 1 -- 172.21.15.100:0/2398391726 wait complete. 2024-09-10T21:06:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.132+0000 7f0264c00640 1 Processor -- start 2024-09-10T21:06:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.132+0000 7f0264c00640 1 -- start start 2024-09-10T21:06:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f0264c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02600741e0 0x7f026014be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f0264c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 0x7f02600b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f0264c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015c750 0x7f02601527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f0264c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02600b29e0 con 0x7f026015b680 2024-09-10T21:06:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f0264c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02600b2860 con 0x7f026015c750 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f0264c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f02600b2b60 con 0x7f02600741e0 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f025d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 0x7f02600b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f025d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 0x7f02600b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53870/0 (socket says 172.21.15.100:53870) 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f025d400640 1 -- 172.21.15.100:0/1304200939 learned_addr learned my addr 172.21.15.100:0/1304200939 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f025de00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02600741e0 0x7f026014be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.133+0000 7f025e800640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015c750 0x7f02601527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f025d400640 1 -- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02600741e0 msgr2=0x7f026014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f025d400640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02600741e0 0x7f026014be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f025d400640 1 -- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015c750 msgr2=0x7f02601527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f025d400640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015c750 0x7f02601527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f025d400640 1 -- 172.21.15.100:0/1304200939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02601f20b0 con 0x7f026015b680 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f025d400640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 0x7f02600b0590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f024c009850 tx=0x7f024c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:53.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f0256000640 1 -- 172.21.15.100:0/1304200939 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c03f070 con 0x7f026015b680 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f0256000640 1 -- 172.21.15.100:0/1304200939 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f024c005600 con 0x7f026015b680 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f0256000640 1 -- 172.21.15.100:0/1304200939 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c035030 con 0x7f026015b680 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02601f5b40 con 0x7f026015b680 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.134+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02601f6100 con 0x7f026015b680 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.135+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02600b3080 con 0x7f026015b680 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.136+0000 7f0256000640 1 -- 172.21.15.100:0/1304200939 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f024c0049e0 con 0x7f026015b680 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.137+0000 7f0256000640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.137+0000 7f0256000640 1 -- 172.21.15.100:0/1304200939 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f024c0bb0c0 con 0x7f026015b680 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.138+0000 7f025de00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.138+0000 7f025de00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f02600cc050 tx=0x7f0250009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.141+0000 7f0256000640 1 -- 172.21.15.100:0/1304200939 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f024c0837c0 con 0x7f026015b680 2024-09-10T21:06:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.337+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f02600cc490 con 0x7f026015b680 2024-09-10T21:06:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.338+0000 7f0256000640 1 -- 172.21.15.100:0/1304200939 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f024c0830c0 con 0x7f026015b680 2024-09-10T21:06:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 msgr2=0x7f024007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f02600cc050 tx=0x7f0250009040 comp rx=0 tx=0).stop 2024-09-10T21:06:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 msgr2=0x7f02600b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 0x7f02600b0590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f024c009850 tx=0x7f024c0038a0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 shutdown_connections 2024-09-10T21:06:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0240077f70 0x7f024007a430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f026015c750 0x7f02601527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f026015b680 0x7f02600b0590 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 --2- 172.21.15.100:0/1304200939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02600741e0 0x7f026014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 >> 172.21.15.100:0/1304200939 conn(0x7f026006cb50 msgr2=0x7f026015ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 shutdown_connections 2024-09-10T21:06:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.340+0000 7f0264c00640 1 -- 172.21.15.100:0/1304200939 wait complete. 2024-09-10T21:06:53.359 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:06:53.359 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:53.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:53.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.588+0000 7fab69c00640 1 -- 172.21.15.100:0/4025159001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640727b0 msgr2=0x7fab640ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.588+0000 7fab69c00640 1 --2- 172.21.15.100:0/4025159001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640727b0 0x7fab640ae8c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fab50009830 tx=0x7fab5002a510 comp rx=0 tx=0).stop 2024-09-10T21:06:53.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.589+0000 7fab69c00640 1 -- 172.21.15.100:0/4025159001 shutdown_connections 2024-09-10T21:06:53.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.589+0000 7fab69c00640 1 --2- 172.21.15.100:0/4025159001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640727b0 0x7fab640ae8c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.589+0000 7fab69c00640 1 --2- 172.21.15.100:0/4025159001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab64150d80 0x7fab64072270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.589+0000 7fab69c00640 1 -- 172.21.15.100:0/4025159001 >> 172.21.15.100:0/4025159001 conn(0x7fab640b1480 msgr2=0x7fab640b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:53.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.589+0000 7fab69c00640 1 -- 172.21.15.100:0/4025159001 shutdown_connections 2024-09-10T21:06:53.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.589+0000 7fab69c00640 1 -- 172.21.15.100:0/4025159001 wait complete. 2024-09-10T21:06:53.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.590+0000 7fab69c00640 1 Processor -- start 2024-09-10T21:06:53.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.590+0000 7fab69c00640 1 -- start start 2024-09-10T21:06:53.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.591+0000 7fab69c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab6406f7e0 0x7fab641f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:53.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.591+0000 7fab69c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab640727b0 0x7fab641e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:53.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.591+0000 7fab69c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64150d80 0x7fab641f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:53.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.591+0000 7fab69c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab640af190 con 0x7fab64150d80 2024-09-10T21:06:53.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.591+0000 7fab69c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fab640af010 con 0x7fab640727b0 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.591+0000 7fab69c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fab640b2e90 con 0x7fab6406f7e0 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64150d80 0x7fab641f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64150d80 0x7fab641f2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53882/0 (socket says 172.21.15.100:53882) 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 -- 172.21.15.100:0/1224123897 learned_addr learned my addr 172.21.15.100:0/1224123897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab63e00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab6406f7e0 0x7fab641f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab63400640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab640727b0 0x7fab641e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 -- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab6406f7e0 msgr2=0x7fab641f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab6406f7e0 0x7fab641f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 -- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab640727b0 msgr2=0x7fab641e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab640727b0 0x7fab641e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 -- 172.21.15.100:0/1224123897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab641f2ab0 con 0x7fab64150d80 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.592+0000 7fab69200640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64150d80 0x7fab641f2140 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c400 tx=0x7fab5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.593+0000 7fab5be00640 1 -- 172.21.15.100:0/1224123897 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c011790 con 0x7fab64150d80 2024-09-10T21:06:53.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.593+0000 7fab5be00640 1 -- 172.21.15.100:0/1224123897 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab5c017070 con 0x7fab64150d80 2024-09-10T21:06:53.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.593+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab641f2d90 con 0x7fab64150d80 2024-09-10T21:06:53.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.593+0000 7fab5be00640 1 -- 172.21.15.100:0/1224123897 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c011d00 con 0x7fab64150d80 2024-09-10T21:06:53.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.593+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab641e0580 con 0x7fab64150d80 2024-09-10T21:06:53.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.594+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab640b44c0 con 0x7fab64150d80 2024-09-10T21:06:53.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.595+0000 7fab5be00640 1 -- 172.21.15.100:0/1224123897 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fab5c01c460 con 0x7fab64150d80 2024-09-10T21:06:53.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.596+0000 7fab5be00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fab44077f70 0x7fab4407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:53.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.596+0000 7fab5be00640 1 -- 172.21.15.100:0/1224123897 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fab5c099d40 con 0x7fab64150d80 2024-09-10T21:06:53.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.596+0000 7fab63e00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fab44077f70 0x7fab4407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:53.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.597+0000 7fab63e00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fab44077f70 0x7fab4407a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fab54005fd0 tx=0x7fab5400a670 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:53.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.600+0000 7fab5be00640 1 -- 172.21.15.100:0/1224123897 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fab5c001120 con 0x7fab64150d80 2024-09-10T21:06:53.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.793+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fab640ae260 con 0x7fab64150d80 2024-09-10T21:06:53.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.794+0000 7fab5be00640 1 -- 172.21.15.100:0/1224123897 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fab5c061e90 con 0x7fab64150d80 2024-09-10T21:06:53.798 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fab44077f70 msgr2=0x7fab4407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fab44077f70 0x7fab4407a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fab54005fd0 tx=0x7fab5400a670 comp rx=0 tx=0).stop 2024-09-10T21:06:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64150d80 msgr2=0x7fab641f2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64150d80 0x7fab641f2140 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c400 tx=0x7fab5c00c8c0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 shutdown_connections 2024-09-10T21:06:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64150d80 0x7fab641f2140 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fab44077f70 0x7fab4407a430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab640727b0 0x7fab641e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 --2- 172.21.15.100:0/1224123897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab6406f7e0 0x7fab641f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:53.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 >> 172.21.15.100:0/1224123897 conn(0x7fab640b1480 msgr2=0x7fab6406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:53.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 shutdown_connections 2024-09-10T21:06:53.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:53.796+0000 7fab69c00640 1 -- 172.21.15.100:0/1224123897 wait complete. 2024-09-10T21:06:53.816 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-09-10T21:06:53.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:53.816 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-10T21:06:53.872 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:06:53.873 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:06:53.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:53.873 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T21:06:53.909 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:06:53.909 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:53.946 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:06:53.946 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:54.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:54.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.177+0000 7f05c4400640 1 -- 172.21.15.100:0/3959161954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05a4003a00 msgr2=0x7f05a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.177+0000 7f05c4400640 1 --2- 172.21.15.100:0/3959161954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05a4003a00 0x7f05a4003e20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009d00 tx=0x7f05a4005830 comp rx=0 tx=0).stop 2024-09-10T21:06:54.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.177+0000 7f05c2400640 1 -- 172.21.15.100:0/3959161954 reap_dead start 2024-09-10T21:06:54.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.177+0000 7f05c4400640 1 -- 172.21.15.100:0/3959161954 shutdown_connections 2024-09-10T21:06:54.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.177+0000 7f05c4400640 1 -- 172.21.15.100:0/3959161954 >> 172.21.15.100:0/3959161954 conn(0x7f05bc06cb50 msgr2=0x7f05bc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:54.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.177+0000 7f05c4400640 1 -- 172.21.15.100:0/3959161954 shutdown_connections 2024-09-10T21:06:54.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.177+0000 7f05c4400640 1 -- 172.21.15.100:0/3959161954 wait complete. 2024-09-10T21:06:54.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.179+0000 7f05c4400640 1 Processor -- start 2024-09-10T21:06:54.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.179+0000 7f05c4400640 1 -- start start 2024-09-10T21:06:54.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.179+0000 7f05c4400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05a4003a00 0x7f05bc0a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:54.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c4400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05bc0b16a0 0x7f05bc0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:54.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c4400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05bc138b30 0x7f05bc138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:54.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c4400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc073d00 con 0x7f05bc138b30 2024-09-10T21:06:54.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c4400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc073b80 con 0x7f05a4003a00 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c4400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f05bc073e80 con 0x7f05bc0b16a0 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05bc138b30 0x7f05bc138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05bc138b30 0x7f05bc138fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53898/0 (socket says 172.21.15.100:53898) 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 -- 172.21.15.100:0/1160516253 learned_addr learned my addr 172.21.15.100:0/1160516253 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c1000640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05bc0b16a0 0x7f05bc0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c1a00640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05a4003a00 0x7f05bc0a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 -- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05bc0b16a0 msgr2=0x7f05bc0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05bc0b16a0 0x7f05bc0b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 -- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05a4003a00 msgr2=0x7f05bc0a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05a4003a00 0x7f05bc0a94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 -- 172.21.15.100:0/1160516253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc157440 con 0x7f05bc138b30 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.180+0000 7f05c2400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05bc138b30 0x7f05bc138fb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f05bc15da00 tx=0x7f05b400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:54.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.181+0000 7f05b9600640 1 -- 172.21.15.100:0/1160516253 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4017070 con 0x7f05bc138b30 2024-09-10T21:06:54.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.181+0000 7f05b9600640 1 -- 172.21.15.100:0/1160516253 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05b4015070 con 0x7f05bc138b30 2024-09-10T21:06:54.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.181+0000 7f05b9600640 1 -- 172.21.15.100:0/1160516253 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4005280 con 0x7f05bc138b30 2024-09-10T21:06:54.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.181+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc157720 con 0x7f05bc138b30 2024-09-10T21:06:54.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.181+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05bc154b60 con 0x7f05bc138b30 2024-09-10T21:06:54.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.182+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc074410 con 0x7f05bc138b30 2024-09-10T21:06:54.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.183+0000 7f05b9600640 1 -- 172.21.15.100:0/1160516253 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f05b4005420 con 0x7f05bc138b30 2024-09-10T21:06:54.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.184+0000 7f05b9600640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f059c077fa0 0x7f059c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:54.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.185+0000 7f05b9600640 1 -- 172.21.15.100:0/1160516253 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f05b409ab80 con 0x7f05bc138b30 2024-09-10T21:06:54.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.185+0000 7f05c1a00640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f059c077fa0 0x7f059c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:54.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.185+0000 7f05c1a00640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f059c077fa0 0x7f059c07a460 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f05b0035000 tx=0x7f05b00046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:54.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.188+0000 7f05b9600640 1 -- 172.21.15.100:0/1160516253 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f05b4022020 con 0x7f05bc138b30 2024-09-10T21:06:54.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.381+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05bc0b1180 con 0x7f05bc138b30 2024-09-10T21:06:54.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.382+0000 7f05b9600640 1 -- 172.21.15.100:0/1160516253 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f05b4010e60 con 0x7f05bc138b30 2024-09-10T21:06:54.385 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f059c077fa0 msgr2=0x7f059c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f059c077fa0 0x7f059c07a460 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f05b0035000 tx=0x7f05b00046c0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05bc138b30 msgr2=0x7f05bc138fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05bc138b30 0x7f05bc138fb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f05bc15da00 tx=0x7f05b400e720 comp rx=0 tx=0).stop 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 shutdown_connections 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05bc138b30 0x7f05bc138fb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05bc0b16a0 0x7f05bc0b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f059c077fa0 0x7f059c07a460 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 --2- 172.21.15.100:0/1160516253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05a4003a00 0x7f05bc0a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 >> 172.21.15.100:0/1160516253 conn(0x7f05bc06cb50 msgr2=0x7f05bc1533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 shutdown_connections 2024-09-10T21:06:54.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.384+0000 7f05c4400640 1 -- 172.21.15.100:0/1160516253 wait complete. 2024-09-10T21:06:54.404 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:06:54.404 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:06:54.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:06:54.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.595+0000 7fbfcf800640 1 -- 172.21.15.100:0/2713546586 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbfc815c750 msgr2=0x7fbfc80cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.595+0000 7fbfcf800640 1 --2- 172.21.15.100:0/2713546586 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbfc815c750 0x7fbfc80cf780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0005fd0 tx=0x7fbfc002a8b0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.595+0000 7fbfcf800640 1 -- 172.21.15.100:0/2713546586 shutdown_connections 2024-09-10T21:06:54.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.595+0000 7fbfcf800640 1 --2- 172.21.15.100:0/2713546586 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbfc815c750 0x7fbfc80cf780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.595+0000 7fbfcf800640 1 --2- 172.21.15.100:0/2713546586 >> v2:172.21.15.130:3300/0 conn(0x7fbfc80741e0 0x7fbfc815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.595+0000 7fbfcf800640 1 -- 172.21.15.100:0/2713546586 >> 172.21.15.100:0/2713546586 conn(0x7fbfc806cb50 msgr2=0x7fbfc806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:54.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.595+0000 7fbfcf800640 1 -- 172.21.15.100:0/2713546586 shutdown_connections 2024-09-10T21:06:54.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.596+0000 7fbfcf800640 1 -- 172.21.15.100:0/2713546586 wait complete. 2024-09-10T21:06:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.597+0000 7fbfcf800640 1 Processor -- start 2024-09-10T21:06:54.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.597+0000 7fbfcf800640 1 -- start start 2024-09-10T21:06:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.598+0000 7fbfcf800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfc80741e0 0x7fbfc80ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.598+0000 7fbfcf800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc815b680 0x7fbfc80ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.598+0000 7fbfcf800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbfc815c750 0x7fbfc81527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.598+0000 7fbfcf800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc80b29e0 con 0x7fbfc815b680 2024-09-10T21:06:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.598+0000 7fbfcf800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc80b2860 con 0x7fbfc80741e0 2024-09-10T21:06:54.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.598+0000 7fbfcf800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc80b2b60 con 0x7fbfc815c750 2024-09-10T21:06:54.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfc7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc815b680 0x7fbfc80ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfc7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc815b680 0x7fbfc80ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53910/0 (socket says 172.21.15.100:53910) 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfc7e00640 1 -- 172.21.15.100:0/1824736665 learned_addr learned my addr 172.21.15.100:0/1824736665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfcd800640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbfc815c750 0x7fbfc81527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfcce00640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfc80741e0 0x7fbfc80ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfc7e00640 1 -- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbfc815c750 msgr2=0x7fbfc81527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfc7e00640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbfc815c750 0x7fbfc81527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfc7e00640 1 -- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfc80741e0 msgr2=0x7fbfc80ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfc7e00640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfc80741e0 0x7fbfc80ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.599+0000 7fbfc7e00640 1 -- 172.21.15.100:0/1824736665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc80af600 con 0x7fbfc815b680 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.600+0000 7fbfc7e00640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc815b680 0x7fbfc80ae070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400e9c0 tx=0x7fbfb400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.600+0000 7fbfc4c00640 1 -- 172.21.15.100:0/1824736665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400cde0 con 0x7fbfc815b680 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.600+0000 7fbfc4c00640 1 -- 172.21.15.100:0/1824736665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfb4004020 con 0x7fbfc815b680 2024-09-10T21:06:54.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.600+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc80af8e0 con 0x7fbfc815b680 2024-09-10T21:06:54.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.600+0000 7fbfc4c00640 1 -- 172.21.15.100:0/1824736665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4004450 con 0x7fbfc815b680 2024-09-10T21:06:54.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.600+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc80afea0 con 0x7fbfc815b680 2024-09-10T21:06:54.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.601+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc80b3080 con 0x7fbfc815b680 2024-09-10T21:06:54.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.602+0000 7fbfc4c00640 1 -- 172.21.15.100:0/1824736665 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbfb40035f0 con 0x7fbfc815b680 2024-09-10T21:06:54.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.603+0000 7fbfc4c00640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbfa8077f70 0x7fbfa807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:54.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.603+0000 7fbfc4c00640 1 -- 172.21.15.100:0/1824736665 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fbfb409a960 con 0x7fbfc815b680 2024-09-10T21:06:54.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.604+0000 7fbfcce00640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbfa8077f70 0x7fbfa807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:54.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.604+0000 7fbfcce00640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbfa8077f70 0x7fbfa807a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbfc81eb860 tx=0x7fbfb8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:54.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.607+0000 7fbfc4c00640 1 -- 172.21.15.100:0/1824736665 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbfb4062ab0 con 0x7fbfc815b680 2024-09-10T21:06:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.808+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbfc815ae80 con 0x7fbfc815b680 2024-09-10T21:06:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.808+0000 7fbfc4c00640 1 -- 172.21.15.100:0/1824736665 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fbfb40674e0 con 0x7fbfc815b680 2024-09-10T21:06:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:06:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbfa8077f70 msgr2=0x7fbfa807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbfa8077f70 0x7fbfa807a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbfc81eb860 tx=0x7fbfb8009040 comp rx=0 tx=0).stop 2024-09-10T21:06:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc815b680 msgr2=0x7fbfc80ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc815b680 0x7fbfc80ae070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400e9c0 tx=0x7fbfb400ee80 comp rx=0 tx=0).stop 2024-09-10T21:06:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 shutdown_connections 2024-09-10T21:06:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbfc815c750 0x7fbfc81527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc815b680 0x7fbfc80ae070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbfa8077f70 0x7fbfa807a430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 --2- 172.21.15.100:0/1824736665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfc80741e0 0x7fbfc80ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.810+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 >> 172.21.15.100:0/1824736665 conn(0x7fbfc806cb50 msgr2=0x7fbfc815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.811+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 shutdown_connections 2024-09-10T21:06:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:54.811+0000 7fbfcf800640 1 -- 172.21.15.100:0/1824736665 wait complete. 2024-09-10T21:06:54.830 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi130.front.sepia.ceph.com... 2024-09-10T21:06:54.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:54.830 DEBUG:teuthology.orchestra.run.smithi130:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-10T21:06:54.891 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:06:54.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:06:54.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:06:54.891 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T21:06:54.928 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T21:06:54.928 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:55.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.081+0000 7f0940600640 1 -- 172.21.15.100:0/2802706493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938073c70 msgr2=0x7f093815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.081+0000 7f0940600640 1 --2- 172.21.15.100:0/2802706493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938073c70 0x7f093815bef0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0938074900 tx=0x7f092402a510 comp rx=0 tx=0).stop 2024-09-10T21:06:55.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.081+0000 7f0940600640 1 -- 172.21.15.100:0/2802706493 shutdown_connections 2024-09-10T21:06:55.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.081+0000 7f0940600640 1 --2- 172.21.15.100:0/2802706493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093815ae80 0x7f093815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.081+0000 7f0940600640 1 --2- 172.21.15.100:0/2802706493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938073c70 0x7f093815bef0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.081+0000 7f0940600640 1 -- 172.21.15.100:0/2802706493 >> 172.21.15.100:0/2802706493 conn(0x7f093806cb50 msgr2=0x7f093806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:55.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.081+0000 7f0940600640 1 -- 172.21.15.100:0/2802706493 shutdown_connections 2024-09-10T21:06:55.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.081+0000 7f0940600640 1 -- 172.21.15.100:0/2802706493 wait complete. 2024-09-10T21:06:55.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.083+0000 7f0940600640 1 Processor -- start 2024-09-10T21:06:55.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.083+0000 7f0940600640 1 -- start start 2024-09-10T21:06:55.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.084+0000 7f0940600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0938073c70 0x7f09381f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.084+0000 7f0940600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938154cf0 0x7f09381f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.084+0000 7f0940600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093815ae80 0x7f093815a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.084+0000 7f0940600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f093806fc40 con 0x7f0938154cf0 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.084+0000 7f0940600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f093806fac0 con 0x7f0938073c70 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.084+0000 7f0940600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f093806fdc0 con 0x7f093815ae80 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938154cf0 0x7f09381f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938154cf0 0x7f09381f7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53922/0 (socket says 172.21.15.100:53922) 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 -- 172.21.15.100:0/2898497538 learned_addr learned my addr 172.21.15.100:0/2898497538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093e600640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093815ae80 0x7f093815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093dc00640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0938073c70 0x7f09381f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 -- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093815ae80 msgr2=0x7f093815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093815ae80 0x7f093815a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 -- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0938073c70 msgr2=0x7f09381f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0938073c70 0x7f09381f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 -- 172.21.15.100:0/2898497538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09381f8500 con 0x7f0938154cf0 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.085+0000 7f093d200640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938154cf0 0x7f09381f7fc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0924009850 tx=0x7f0924003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.086+0000 7f0935600640 1 -- 172.21.15.100:0/2898497538 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092403f070 con 0x7f0938154cf0 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.086+0000 7f0935600640 1 -- 172.21.15.100:0/2898497538 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09240047a0 con 0x7f0938154cf0 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.086+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09381f4600 con 0x7f0938154cf0 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.086+0000 7f0935600640 1 -- 172.21.15.100:0/2898497538 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0924035030 con 0x7f0938154cf0 2024-09-10T21:06:55.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.086+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09381f4ea0 con 0x7f0938154cf0 2024-09-10T21:06:55.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.087+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09380702b0 con 0x7f0938154cf0 2024-09-10T21:06:55.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.088+0000 7f0935600640 1 -- 172.21.15.100:0/2898497538 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0924004bb0 con 0x7f0938154cf0 2024-09-10T21:06:55.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.089+0000 7f0935600640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0918077f70 0x7f091807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.089+0000 7f0935600640 1 -- 172.21.15.100:0/2898497538 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f09240bb150 con 0x7f0938154cf0 2024-09-10T21:06:55.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.089+0000 7f093dc00640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0918077f70 0x7f091807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.090+0000 7f093dc00640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0918077f70 0x7f091807a430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f092c004f60 tx=0x7f092c007e30 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:55.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.093+0000 7f0935600640 1 -- 172.21.15.100:0/2898497538 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f09240832a0 con 0x7f0938154cf0 2024-09-10T21:06:55.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.308+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09380cdbe0 con 0x7f0938154cf0 2024-09-10T21:06:55.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.309+0000 7f0935600640 1 -- 172.21.15.100:0/2898497538 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f0924087cd0 con 0x7f0938154cf0 2024-09-10T21:06:55.313 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:55.313 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-10T21:06:23:611303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:23.012445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:55.313 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-10T21:06:55.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.311+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0918077f70 msgr2=0x7f091807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.311+0000 7f0940600640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0918077f70 0x7f091807a430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f092c004f60 tx=0x7f092c007e30 comp rx=0 tx=0).stop 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.311+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938154cf0 msgr2=0x7f09381f7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.311+0000 7f0940600640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938154cf0 0x7f09381f7fc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0924009850 tx=0x7f0924003910 comp rx=0 tx=0).stop 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.312+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 shutdown_connections 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.312+0000 7f0940600640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f093815ae80 0x7f093815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.312+0000 7f0940600640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0938154cf0 0x7f09381f7fc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.312+0000 7f0940600640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0918077f70 0x7f091807a430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.312+0000 7f0940600640 1 --2- 172.21.15.100:0/2898497538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0938073c70 0x7f09381f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.312+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 >> 172.21.15.100:0/2898497538 conn(0x7f093806cb50 msgr2=0x7f09380ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:55.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.312+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 shutdown_connections 2024-09-10T21:06:55.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.312+0000 7f0940600640 1 -- 172.21.15.100:0/2898497538 wait complete. 2024-09-10T21:06:55.331 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:55.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 -- 172.21.15.100:0/2487308360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80ced60 msgr2=0x7fc7e80cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 --2- 172.21.15.100:0/2487308360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80ced60 0x7fc7e80cf210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80ce350 tx=0x7fc7e002a9a0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 -- 172.21.15.100:0/2487308360 shutdown_connections 2024-09-10T21:06:55.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 --2- 172.21.15.100:0/2487308360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80ced60 0x7fc7e80cf210 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 --2- 172.21.15.100:0/2487308360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7e806cb50 0x7fc7e806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 --2- 172.21.15.100:0/2487308360 >> v2:172.21.15.130:3300/0 conn(0x7fc7e80affb0 0x7fc7e80cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 -- 172.21.15.100:0/2487308360 >> 172.21.15.100:0/2487308360 conn(0x7fc7e80b26e0 msgr2=0x7fc7e80b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:55.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 -- 172.21.15.100:0/2487308360 shutdown_connections 2024-09-10T21:06:55.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.484+0000 7fc7ee400640 1 -- 172.21.15.100:0/2487308360 wait complete. 2024-09-10T21:06:55.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.486+0000 7fc7ee400640 1 Processor -- start 2024-09-10T21:06:55.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.486+0000 7fc7ee400640 1 -- start start 2024-09-10T21:06:55.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7ee400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7e806cb50 0x7fc7e815e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7ee400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80affb0 0x7fc7e80b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7ee400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7e80ced60 0x7fc7e8142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7ee400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8073690 con 0x7fc7e80affb0 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7ee400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8073510 con 0x7fc7e80ced60 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7ee400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e8073810 con 0x7fc7e806cb50 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7e7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80affb0 0x7fc7e80b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7e7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80affb0 0x7fc7e80b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53936/0 (socket says 172.21.15.100:53936) 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7e7e00640 1 -- 172.21.15.100:0/381661932 learned_addr learned my addr 172.21.15.100:0/381661932 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7ed000640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7e806cb50 0x7fc7e815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7eda00640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7e80ced60 0x7fc7e8142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7e7e00640 1 -- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7e806cb50 msgr2=0x7fc7e815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7e7e00640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7e806cb50 0x7fc7e815e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7e7e00640 1 -- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7e80ced60 msgr2=0x7fc7e8142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7e7e00640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7e80ced60 0x7fc7e8142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.487+0000 7fc7e7e00640 1 -- 172.21.15.100:0/381661932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e815eba0 con 0x7fc7e80affb0 2024-09-10T21:06:55.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.488+0000 7fc7e7e00640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80affb0 0x7fc7e80b3800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400e9c0 tx=0x7fc7d400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:55.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.488+0000 7fc7e4c00640 1 -- 172.21.15.100:0/381661932 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400cd80 con 0x7fc7e80affb0 2024-09-10T21:06:55.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.488+0000 7fc7e4c00640 1 -- 172.21.15.100:0/381661932 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7d4004030 con 0x7fc7e80affb0 2024-09-10T21:06:55.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.488+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e80b6090 con 0x7fc7e80affb0 2024-09-10T21:06:55.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.488+0000 7fc7e4c00640 1 -- 172.21.15.100:0/381661932 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4004480 con 0x7fc7e80affb0 2024-09-10T21:06:55.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.488+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e80b6650 con 0x7fc7e80affb0 2024-09-10T21:06:55.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.489+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e80cdce0 con 0x7fc7e80affb0 2024-09-10T21:06:55.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.490+0000 7fc7e4c00640 1 -- 172.21.15.100:0/381661932 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc7d40035f0 con 0x7fc7e80affb0 2024-09-10T21:06:55.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.491+0000 7fc7e4c00640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc7c8077f70 0x7fc7c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.491+0000 7fc7e4c00640 1 -- 172.21.15.100:0/381661932 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fc7d409aba0 con 0x7fc7e80affb0 2024-09-10T21:06:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.492+0000 7fc7ed000640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc7c8077f70 0x7fc7c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.492+0000 7fc7ed000640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc7c8077f70 0x7fc7c807a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0095f0 tx=0x7fc7dc005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:55.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.495+0000 7fc7e4c00640 1 -- 172.21.15.100:0/381661932 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc7d4062bc0 con 0x7fc7e80affb0 2024-09-10T21:06:55.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.713+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7e80b2220 con 0x7fc7e80affb0 2024-09-10T21:06:55.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.714+0000 7fc7e4c00640 1 -- 172.21.15.100:0/381661932 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fc7d40675f0 con 0x7fc7e80affb0 2024-09-10T21:06:55.718 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:55.718 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-10T21:06:23:611303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:23.012445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:55.718 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-10T21:06:55.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc7c8077f70 msgr2=0x7fc7c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc7c8077f70 0x7fc7c807a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0095f0 tx=0x7fc7dc005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:55.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80affb0 msgr2=0x7fc7e80b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80affb0 0x7fc7e80b3800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400e9c0 tx=0x7fc7d400ee80 comp rx=0 tx=0).stop 2024-09-10T21:06:55.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 shutdown_connections 2024-09-10T21:06:55.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc7c8077f70 0x7fc7c807a430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7e80ced60 0x7fc7e8142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7e80affb0 0x7fc7e80b3800 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 --2- 172.21.15.100:0/381661932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7e806cb50 0x7fc7e815e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 >> 172.21.15.100:0/381661932 conn(0x7fc7e80b26e0 msgr2=0x7fc7e815f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:55.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 shutdown_connections 2024-09-10T21:06:55.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.716+0000 7fc7ee400640 1 -- 172.21.15.100:0/381661932 wait complete. 2024-09-10T21:06:55.736 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.891+0000 7ff56e600640 1 -- 172.21.15.100:0/2445763705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 msgr2=0x7ff5680b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.891+0000 7ff56e600640 1 --2- 172.21.15.100:0/2445763705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 0x7ff5680b21c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009830 tx=0x7ff55c02a480 comp rx=0 tx=0).stop 2024-09-10T21:06:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.891+0000 7ff56e600640 1 -- 172.21.15.100:0/2445763705 shutdown_connections 2024-09-10T21:06:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.891+0000 7ff56e600640 1 --2- 172.21.15.100:0/2445763705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff56806d060 0x7ff56806d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.891+0000 7ff56e600640 1 --2- 172.21.15.100:0/2445763705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 0x7ff5680b21c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.891+0000 7ff56e600640 1 -- 172.21.15.100:0/2445763705 >> 172.21.15.100:0/2445763705 conn(0x7ff5680d3ab0 msgr2=0x7ff5680d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.891+0000 7ff56e600640 1 -- 172.21.15.100:0/2445763705 shutdown_connections 2024-09-10T21:06:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.891+0000 7ff56e600640 1 -- 172.21.15.100:0/2445763705 wait complete. 2024-09-10T21:06:55.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.892+0000 7ff56e600640 1 Processor -- start 2024-09-10T21:06:55.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.893+0000 7ff56e600640 1 -- start start 2024-09-10T21:06:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.893+0000 7ff56e600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff56806d060 0x7ff5681509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.893+0000 7ff56e600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff56806e0a0 0x7ff5681f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.893+0000 7ff56e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 0x7ff5680b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.893+0000 7ff56e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff56806f170 con 0x7ff568161140 2024-09-10T21:06:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.893+0000 7ff56e600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff56806eff0 con 0x7ff56806d060 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.893+0000 7ff56e600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff568161520 con 0x7ff56806e0a0 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 0x7ff5680b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 0x7ff5680b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53956/0 (socket says 172.21.15.100:53956) 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 -- 172.21.15.100:0/3760176639 learned_addr learned my addr 172.21.15.100:0/3760176639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56d200640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff56806d060 0x7ff5681509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff567e00640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff56806e0a0 0x7ff5681f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 -- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff56806e0a0 msgr2=0x7ff5681f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff56806e0a0 0x7ff5681f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 -- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff56806d060 msgr2=0x7ff5681509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff56806d060 0x7ff5681509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 -- 172.21.15.100:0/3760176639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5681f5140 con 0x7ff568161140 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.894+0000 7ff56dc00640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 0x7ff5680b50e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff56000cce0 tx=0x7ff56000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.895+0000 7ff564c00640 1 -- 172.21.15.100:0/3760176639 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56000f450 con 0x7ff568161140 2024-09-10T21:06:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.895+0000 7ff564c00640 1 -- 172.21.15.100:0/3760176639 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff56000f700 con 0x7ff568161140 2024-09-10T21:06:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.895+0000 7ff564c00640 1 -- 172.21.15.100:0/3760176639 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56000fb50 con 0x7ff568161140 2024-09-10T21:06:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.895+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5680c7e70 con 0x7ff568161140 2024-09-10T21:06:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.895+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5680c8430 con 0x7ff568161140 2024-09-10T21:06:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.896+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5680c7c60 con 0x7ff568161140 2024-09-10T21:06:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.897+0000 7ff564c00640 1 -- 172.21.15.100:0/3760176639 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff56000e3b0 con 0x7ff568161140 2024-09-10T21:06:55.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.898+0000 7ff564c00640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff548077f70 0x7ff54807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:55.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.898+0000 7ff564c00640 1 -- 172.21.15.100:0/3760176639 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7ff56009aec0 con 0x7ff568161140 2024-09-10T21:06:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.898+0000 7ff56d200640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff548077f70 0x7ff54807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.899+0000 7ff56d200640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff548077f70 0x7ff54807a430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff55c034000 tx=0x7ff55c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:55.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:55.902+0000 7ff564c00640 1 -- 172.21.15.100:0/3760176639 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff560014030 con 0x7ff568161140 2024-09-10T21:06:56.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.086+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff56806e800 con 0x7ff568161140 2024-09-10T21:06:56.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.087+0000 7ff564c00640 1 -- 172.21.15.100:0/3760176639 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18907 (secure 0 0 0) 0x7ff560062ee0 con 0x7ff568161140 2024-09-10T21:06:56.091 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:56.091 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:47.727671+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff548077f70 msgr2=0x7ff54807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff548077f70 0x7ff54807a430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff55c034000 tx=0x7ff55c004730 comp rx=0 tx=0).stop 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 msgr2=0x7ff5680b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 0x7ff5680b50e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff56000cce0 tx=0x7ff56000a620 comp rx=0 tx=0).stop 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 shutdown_connections 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff568161140 0x7ff5680b50e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff56806e0a0 0x7ff5681f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff548077f70 0x7ff54807a430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 --2- 172.21.15.100:0/3760176639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff56806d060 0x7ff5681509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 >> 172.21.15.100:0/3760176639 conn(0x7ff5680d3ab0 msgr2=0x7ff5680cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:56.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 shutdown_connections 2024-09-10T21:06:56.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.090+0000 7ff56e600640 1 -- 172.21.15.100:0/3760176639 wait complete. 2024-09-10T21:06:56.109 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T21:06:56.110 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 -- 172.21.15.100:0/333143241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66200741e0 msgr2=0x7f662015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 --2- 172.21.15.100:0/333143241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66200741e0 0x7f662015f4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6620070770 tx=0x7f660802a560 comp rx=0 tx=0).stop 2024-09-10T21:06:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 -- 172.21.15.100:0/333143241 shutdown_connections 2024-09-10T21:06:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 --2- 172.21.15.100:0/333143241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f662015c750 0x7f66200cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 --2- 172.21.15.100:0/333143241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66200741e0 0x7f662015f4d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 --2- 172.21.15.100:0/333143241 >> v2:172.21.15.130:3300/0 conn(0x7f662015b680 0x7f662015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 -- 172.21.15.100:0/333143241 >> 172.21.15.100:0/333143241 conn(0x7f662006cb50 msgr2=0x7f662006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:56.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 -- 172.21.15.100:0/333143241 shutdown_connections 2024-09-10T21:06:56.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.262+0000 7f6626e00640 1 -- 172.21.15.100:0/333143241 wait complete. 2024-09-10T21:06:56.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.264+0000 7f6626e00640 1 Processor -- start 2024-09-10T21:06:56.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.264+0000 7f6626e00640 1 -- start start 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6626e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66200741e0 0x7f6620151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6626e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f662015b680 0x7f66201509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6626e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f662015c750 0x7f66200ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6626e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66200d00d0 con 0x7f662015c750 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6626e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66200cff50 con 0x7f66200741e0 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6626e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f66200b2860 con 0x7f662015b680 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6624e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f662015c750 0x7f66200ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6624e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f662015c750 0x7f66200ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53980/0 (socket says 172.21.15.100:53980) 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6624e00640 1 -- 172.21.15.100:0/279244633 learned_addr learned my addr 172.21.15.100:0/279244633 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6617e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f662015b680 0x7f66201509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f661fe00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66200741e0 0x7f6620151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:56.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6624e00640 1 -- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f662015b680 msgr2=0x7f66201509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6624e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f662015b680 0x7f66201509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6624e00640 1 -- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66200741e0 msgr2=0x7f6620151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.265+0000 7f6624e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66200741e0 0x7f6620151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.266+0000 7f6624e00640 1 -- 172.21.15.100:0/279244633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6620150f20 con 0x7f662015c750 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.266+0000 7f6624e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f662015c750 0x7f66200ae8a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f661800ea80 tx=0x7f661800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.266+0000 7f661cc00640 1 -- 172.21.15.100:0/279244633 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661800ce40 con 0x7f662015c750 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.266+0000 7f661cc00640 1 -- 172.21.15.100:0/279244633 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6618004b20 con 0x7f662015c750 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.266+0000 7f661cc00640 1 -- 172.21.15.100:0/279244633 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618005020 con 0x7f662015c750 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.266+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6620151920 con 0x7f662015c750 2024-09-10T21:06:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.266+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662015aa10 con 0x7f662015c750 2024-09-10T21:06:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.267+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662015ba60 con 0x7f662015c750 2024-09-10T21:06:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.268+0000 7f661cc00640 1 -- 172.21.15.100:0/279244633 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f66180051c0 con 0x7f662015c750 2024-09-10T21:06:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.269+0000 7f661cc00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f65fc077f70 0x7f65fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.269+0000 7f661cc00640 1 -- 172.21.15.100:0/279244633 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f661809abe0 con 0x7f662015c750 2024-09-10T21:06:56.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.270+0000 7f661fe00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f65fc077f70 0x7f65fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:56.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.270+0000 7f661fe00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f65fc077f70 0x7f65fc07a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6610009b50 tx=0x7f6610005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:56.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.273+0000 7f661cc00640 1 -- 172.21.15.100:0/279244633 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6618062d30 con 0x7f662015c750 2024-09-10T21:06:56.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.490+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f662015bd00 con 0x7f662015c750 2024-09-10T21:06:56.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.491+0000 7f661cc00640 1 -- 172.21.15.100:0/279244633 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f6618067760 con 0x7f662015c750 2024-09-10T21:06:56.494 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:56.494 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-10T21:06:23:611303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:23.012445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:56.495 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-10T21:06:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f65fc077f70 msgr2=0x7f65fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f65fc077f70 0x7f65fc07a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6610009b50 tx=0x7f6610005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f662015c750 msgr2=0x7f66200ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f662015c750 0x7f66200ae8a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f661800ea80 tx=0x7f661800ef40 comp rx=0 tx=0).stop 2024-09-10T21:06:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 shutdown_connections 2024-09-10T21:06:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f662015c750 0x7f66200ae8a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f662015b680 0x7f66201509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f65fc077f70 0x7f65fc07a430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 --2- 172.21.15.100:0/279244633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66200741e0 0x7f6620151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 >> 172.21.15.100:0/279244633 conn(0x7f662006cb50 msgr2=0x7f66200cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:56.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 shutdown_connections 2024-09-10T21:06:56.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.493+0000 7f6626e00640 1 -- 172.21.15.100:0/279244633 wait complete. 2024-09-10T21:06:56.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:06:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.665+0000 7fbef8600640 1 -- 172.21.15.100:0/3415781023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015b680 msgr2=0x7fbef015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.665+0000 7fbef8600640 1 --2- 172.21.15.100:0/3415781023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015b680 0x7fbef015ba60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbef0074660 tx=0x7fbee402a560 comp rx=0 tx=0).stop 2024-09-10T21:06:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.666+0000 7fbef8600640 1 -- 172.21.15.100:0/3415781023 shutdown_connections 2024-09-10T21:06:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.666+0000 7fbef8600640 1 --2- 172.21.15.100:0/3415781023 >> v2:172.21.15.130:3300/0 conn(0x7fbef00741e0 0x7fbef015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.666+0000 7fbef8600640 1 --2- 172.21.15.100:0/3415781023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015b680 0x7fbef015ba60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.666+0000 7fbef8600640 1 -- 172.21.15.100:0/3415781023 >> 172.21.15.100:0/3415781023 conn(0x7fbef006cb50 msgr2=0x7fbef006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.666+0000 7fbef8600640 1 -- 172.21.15.100:0/3415781023 shutdown_connections 2024-09-10T21:06:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.666+0000 7fbef8600640 1 -- 172.21.15.100:0/3415781023 wait complete. 2024-09-10T21:06:56.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.667+0000 7fbef8600640 1 Processor -- start 2024-09-10T21:06:56.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.667+0000 7fbef8600640 1 -- start start 2024-09-10T21:06:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.668+0000 7fbef8600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbef00741e0 0x7fbef015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.668+0000 7fbef8600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef015b680 0x7fbef0157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.668+0000 7fbef8600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015c750 0x7fbef00b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.668+0000 7fbef8600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbef00b2860 con 0x7fbef015c750 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.668+0000 7fbef8600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbef015cf00 con 0x7fbef015b680 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.668+0000 7fbef8600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbef00b29e0 con 0x7fbef00741e0 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015c750 0x7fbef00b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef5200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef015b680 0x7fbef0157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015c750 0x7fbef00b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54006/0 (socket says 172.21.15.100:54006) 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 -- 172.21.15.100:0/2881729888 learned_addr learned my addr 172.21.15.100:0/2881729888 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef5c00640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbef00741e0 0x7fbef015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 -- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbef00741e0 msgr2=0x7fbef015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbef00741e0 0x7fbef015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 -- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef015b680 msgr2=0x7fbef0157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef015b680 0x7fbef0157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 -- 172.21.15.100:0/2881729888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef0158060 con 0x7fbef015c750 2024-09-10T21:06:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.669+0000 7fbef6600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015c750 0x7fbef00b1240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbee800b970 tx=0x7fbee800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.670+0000 7fbeed600640 1 -- 172.21.15.100:0/2881729888 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8019070 con 0x7fbef015c750 2024-09-10T21:06:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.670+0000 7fbeed600640 1 -- 172.21.15.100:0/2881729888 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbee800cc30 con 0x7fbef015c750 2024-09-10T21:06:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.670+0000 7fbeed600640 1 -- 172.21.15.100:0/2881729888 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee800ce60 con 0x7fbef015c750 2024-09-10T21:06:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.670+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef0153940 con 0x7fbef015c750 2024-09-10T21:06:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.670+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef015ada0 con 0x7fbef015c750 2024-09-10T21:06:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.671+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef015f4d0 con 0x7fbef015c750 2024-09-10T21:06:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.672+0000 7fbeed600640 1 -- 172.21.15.100:0/2881729888 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbee801e440 con 0x7fbef015c750 2024-09-10T21:06:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.673+0000 7fbeed600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbed0077f70 0x7fbed007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.673+0000 7fbeed600640 1 -- 172.21.15.100:0/2881729888 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fbee8099fe0 con 0x7fbef015c750 2024-09-10T21:06:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.673+0000 7fbef5c00640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbed0077f70 0x7fbed007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.674+0000 7fbef5c00640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbed0077f70 0x7fbed007a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbee4033000 tx=0x7fbee4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.677+0000 7fbeed600640 1 -- 172.21.15.100:0/2881729888 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbee80620d0 con 0x7fbef015c750 2024-09-10T21:06:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.894+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbef00cc490 con 0x7fbef015c750 2024-09-10T21:06:56.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.895+0000 7fbeed600640 1 -- 172.21.15.100:0/2881729888 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fbee8066b00 con 0x7fbef015c750 2024-09-10T21:06:56.899 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:56.899 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":9,"btime":"2024-09-10T21:06:23:611303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3378646233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3378646233},{"type":"v1","addr":"172.21.15.100:6834","nonce":3378646233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2518344272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2518344272},{"type":"v1","addr":"172.21.15.100:6835","nonce":2518344272}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/2564360225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":2564360225},{"type":"v1","addr":"172.21.15.130:6836","nonce":2564360225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:06:07.129552+0000","modified":"2024-09-10T21:06:23.012445+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6837/2407425318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2407425318},{"type":"v1","addr":"172.21.15.130:6837","nonce":2407425318}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-10T21:06:56.899 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 9 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.897+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbed0077f70 msgr2=0x7fbed007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.897+0000 7fbef8600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbed0077f70 0x7fbed007a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbee4033000 tx=0x7fbee4004730 comp rx=0 tx=0).stop 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.897+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015c750 msgr2=0x7fbef00b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.897+0000 7fbef8600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015c750 0x7fbef00b1240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbee800b970 tx=0x7fbee800be30 comp rx=0 tx=0).stop 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.898+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 shutdown_connections 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.898+0000 7fbef8600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef015c750 0x7fbef00b1240 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.898+0000 7fbef8600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbed0077f70 0x7fbed007a430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.898+0000 7fbef8600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef015b680 0x7fbef0157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.898+0000 7fbef8600640 1 --2- 172.21.15.100:0/2881729888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbef00741e0 0x7fbef015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.898+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 >> 172.21.15.100:0/2881729888 conn(0x7fbef006cb50 msgr2=0x7fbef006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.898+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 shutdown_connections 2024-09-10T21:06:56.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:56.898+0000 7fbef8600640 1 -- 172.21.15.100:0/2881729888 wait complete. 2024-09-10T21:06:56.917 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.071+0000 7fd5f0000640 1 -- 172.21.15.100:0/2611255482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e80741e0 msgr2=0x7fd5e815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.071+0000 7fd5f0000640 1 --2- 172.21.15.100:0/2611255482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e80741e0 0x7fd5e815f4d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80cd2b0 tx=0x7fd5d402a5f0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.071+0000 7fd5f0000640 1 -- 172.21.15.100:0/2611255482 shutdown_connections 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.071+0000 7fd5f0000640 1 --2- 172.21.15.100:0/2611255482 >> v2:172.21.15.130:3300/0 conn(0x7fd5e815c750 0x7fd5e80cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.071+0000 7fd5f0000640 1 --2- 172.21.15.100:0/2611255482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e80741e0 0x7fd5e815f4d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.071+0000 7fd5f0000640 1 -- 172.21.15.100:0/2611255482 >> 172.21.15.100:0/2611255482 conn(0x7fd5e806cb50 msgr2=0x7fd5e806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.071+0000 7fd5f0000640 1 -- 172.21.15.100:0/2611255482 shutdown_connections 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.071+0000 7fd5f0000640 1 -- 172.21.15.100:0/2611255482 wait complete. 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.073+0000 7fd5f0000640 1 Processor -- start 2024-09-10T21:06:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.073+0000 7fd5f0000640 1 -- start start 2024-09-10T21:06:57.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5f0000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5e80741e0 0x7fd5e8156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5f0000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e815b680 0x7fd5e81f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5f0000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5e815c750 0x7fd5e80a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5f0000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80b2860 con 0x7fd5e815b680 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5f0000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80d00d0 con 0x7fd5e815c750 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5f0000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e80b29e0 con 0x7fd5e80741e0 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ecc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e815b680 0x7fd5e81f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ecc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e815b680 0x7fd5e81f93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54026/0 (socket says 172.21.15.100:54026) 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ecc00640 1 -- 172.21.15.100:0/1166815542 learned_addr learned my addr 172.21.15.100:0/1166815542 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ee000640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5e815c750 0x7fd5e80a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ed600640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5e80741e0 0x7fd5e8156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ecc00640 1 -- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5e80741e0 msgr2=0x7fd5e8156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ecc00640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5e80741e0 0x7fd5e8156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ecc00640 1 -- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5e815c750 msgr2=0x7fd5e80a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.074+0000 7fd5ecc00640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5e815c750 0x7fd5e80a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.075+0000 7fd5ecc00640 1 -- 172.21.15.100:0/1166815542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e81f9900 con 0x7fd5e815b680 2024-09-10T21:06:57.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.075+0000 7fd5ecc00640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e815b680 0x7fd5e81f93c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd5d402abe0 tx=0x7fd5d40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:57.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.075+0000 7fd5e5600640 1 -- 172.21.15.100:0/1166815542 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d403f070 con 0x7fd5e815b680 2024-09-10T21:06:57.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.075+0000 7fd5e5600640 1 -- 172.21.15.100:0/1166815542 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5d4004890 con 0x7fd5e815b680 2024-09-10T21:06:57.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.075+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e815e400 con 0x7fd5e815b680 2024-09-10T21:06:57.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.075+0000 7fd5e5600640 1 -- 172.21.15.100:0/1166815542 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4035030 con 0x7fd5e815b680 2024-09-10T21:06:57.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.075+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e815e9c0 con 0x7fd5e815b680 2024-09-10T21:06:57.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.076+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e815f4d0 con 0x7fd5e815b680 2024-09-10T21:06:57.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.077+0000 7fd5e5600640 1 -- 172.21.15.100:0/1166815542 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd5d4004ce0 con 0x7fd5e815b680 2024-09-10T21:06:57.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.078+0000 7fd5e5600640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd5c8077fa0 0x7fd5c807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.078+0000 7fd5e5600640 1 -- 172.21.15.100:0/1166815542 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fd5d40bb280 con 0x7fd5e815b680 2024-09-10T21:06:57.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.079+0000 7fd5ed600640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd5c8077fa0 0x7fd5c807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.080+0000 7fd5ed600640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd5c8077fa0 0x7fd5c807a460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0012e0 tx=0x7fd5dc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:57.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.082+0000 7fd5e5600640 1 -- 172.21.15.100:0/1166815542 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd5e81f9900 con 0x7fd5e815b680 2024-09-10T21:06:57.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.265+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5e80cc490 con 0x7fd5e815b680 2024-09-10T21:06:57.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.266+0000 7fd5e5600640 1 -- 172.21.15.100:0/1166815542 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18907 (secure 0 0 0) 0x7fd5d40832a0 con 0x7fd5e815b680 2024-09-10T21:06:57.270 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:06:57.270 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:06:47.727671+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:06:05.121377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:06:06.089408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T21:06:09.739207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.268+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd5c8077fa0 msgr2=0x7fd5c807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.268+0000 7fd5f0000640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd5c8077fa0 0x7fd5c807a460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0012e0 tx=0x7fd5dc009040 comp rx=0 tx=0).stop 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.268+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e815b680 msgr2=0x7fd5e81f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.268+0000 7fd5f0000640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e815b680 0x7fd5e81f93c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd5d402abe0 tx=0x7fd5d40039e0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.269+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 shutdown_connections 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.269+0000 7fd5f0000640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd5c8077fa0 0x7fd5c807a460 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.269+0000 7fd5f0000640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5e815c750 0x7fd5e80a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.269+0000 7fd5f0000640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5e815b680 0x7fd5e81f93c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.269+0000 7fd5f0000640 1 --2- 172.21.15.100:0/1166815542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5e80741e0 0x7fd5e8156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.269+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 >> 172.21.15.100:0/1166815542 conn(0x7fd5e806cb50 msgr2=0x7fd5e80aed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.269+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 shutdown_connections 2024-09-10T21:06:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.269+0000 7fd5f0000640 1 -- 172.21.15.100:0/1166815542 wait complete. 2024-09-10T21:06:57.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T21:06:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.442+0000 7f7f40400640 1 -- 172.21.15.100:0/1101048544 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f380741e0 msgr2=0x7f7f3815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.442+0000 7f7f40400640 1 --2- 172.21.15.100:0/1101048544 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f380741e0 0x7f7f3815f4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f24005fd0 tx=0x7f7f2402a5d0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.442+0000 7f7f40400640 1 -- 172.21.15.100:0/1101048544 shutdown_connections 2024-09-10T21:06:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.442+0000 7f7f40400640 1 --2- 172.21.15.100:0/1101048544 >> v2:172.21.15.130:3300/0 conn(0x7f7f3815c750 0x7f7f380cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.442+0000 7f7f40400640 1 --2- 172.21.15.100:0/1101048544 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f380741e0 0x7f7f3815f4d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.442+0000 7f7f40400640 1 -- 172.21.15.100:0/1101048544 >> 172.21.15.100:0/1101048544 conn(0x7f7f3806cb50 msgr2=0x7f7f3806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.443+0000 7f7f40400640 1 -- 172.21.15.100:0/1101048544 shutdown_connections 2024-09-10T21:06:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.443+0000 7f7f40400640 1 -- 172.21.15.100:0/1101048544 wait complete. 2024-09-10T21:06:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.444+0000 7f7f40400640 1 Processor -- start 2024-09-10T21:06:57.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.444+0000 7f7f40400640 1 -- start start 2024-09-10T21:06:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.445+0000 7f7f40400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f380741e0 0x7f7f3815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.445+0000 7f7f40400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f3815b680 0x7f7f38147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.445+0000 7f7f40400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3815c750 0x7f7f38144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.445+0000 7f7f40400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f380b29e0 con 0x7f7f3815c750 2024-09-10T21:06:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.445+0000 7f7f40400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f380b2860 con 0x7f7f3815b680 2024-09-10T21:06:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.445+0000 7f7f40400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7f380b2b60 con 0x7f7f380741e0 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.445+0000 7f7f3e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3815c750 0x7f7f38144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3815c750 0x7f7f38144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54030/0 (socket says 172.21.15.100:54030) 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3e400640 1 -- 172.21.15.100:0/88142013 learned_addr learned my addr 172.21.15.100:0/88142013 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3d000640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f3815b680 0x7f7f38147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3da00640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f380741e0 0x7f7f3815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3e400640 1 -- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f380741e0 msgr2=0x7f7f3815ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3e400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f380741e0 0x7f7f3815ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3e400640 1 -- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f3815b680 msgr2=0x7f7f38147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3e400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f3815b680 0x7f7f38147e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3e400640 1 -- 172.21.15.100:0/88142013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f38148390 con 0x7f7f3815c750 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f3e400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3815c750 0x7f7f38144980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000ea80 tx=0x7f7f3000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.446+0000 7f7f35600640 1 -- 172.21.15.100:0/88142013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30004b20 con 0x7f7f3815c750 2024-09-10T21:06:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.447+0000 7f7f35600640 1 -- 172.21.15.100:0/88142013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f30004ce0 con 0x7f7f3815c750 2024-09-10T21:06:57.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.447+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f38153fa0 con 0x7f7f3815c750 2024-09-10T21:06:57.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.447+0000 7f7f35600640 1 -- 172.21.15.100:0/88142013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30005280 con 0x7f7f3815c750 2024-09-10T21:06:57.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.447+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f3815e450 con 0x7f7f3815c750 2024-09-10T21:06:57.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.448+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f381578d0 con 0x7f7f3815c750 2024-09-10T21:06:57.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.449+0000 7f7f35600640 1 -- 172.21.15.100:0/88142013 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7f30005420 con 0x7f7f3815c750 2024-09-10T21:06:57.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.450+0000 7f7f35600640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f18077f70 0x7f7f1807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.450+0000 7f7f35600640 1 -- 172.21.15.100:0/88142013 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f7f3009ad30 con 0x7f7f3815c750 2024-09-10T21:06:57.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.451+0000 7f7f3da00640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f18077f70 0x7f7f1807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.452+0000 7f7f3da00640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f18077f70 0x7f7f1807a430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0017c0 tx=0x7f7f2c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:57.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.455+0000 7f7f35600640 1 -- 172.21.15.100:0/88142013 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7f381578d0 con 0x7f7f3815c750 2024-09-10T21:06:57.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.671+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7f380b3080 con 0x7f7f3815c750 2024-09-10T21:06:57.675 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-09-10T21:06:57.671+0000 7f3d5ea00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:06:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.673+0000 7f7f35600640 1 -- 172.21.15.100:0/88142013 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f7f38148390 con 0x7f7f3815c750 2024-09-10T21:06:57.677 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T21:06:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f18077f70 msgr2=0x7f7f1807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f18077f70 0x7f7f1807a430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0017c0 tx=0x7f7f2c009040 comp rx=0 tx=0).stop 2024-09-10T21:06:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3815c750 msgr2=0x7f7f38144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3815c750 0x7f7f38144980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000ea80 tx=0x7f7f3000ef40 comp rx=0 tx=0).stop 2024-09-10T21:06:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 shutdown_connections 2024-09-10T21:06:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3815c750 0x7f7f38144980 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7f18077f70 0x7f7f1807a430 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f3815b680 0x7f7f38147e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.677+0000 7f7f40400640 1 --2- 172.21.15.100:0/88142013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f380741e0 0x7f7f3815ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.678+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 >> 172.21.15.100:0/88142013 conn(0x7f7f3806cb50 msgr2=0x7f7f380ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.678+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 shutdown_connections 2024-09-10T21:06:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.678+0000 7f7f40400640 1 -- 172.21.15.100:0/88142013 wait complete. 2024-09-10T21:06:57.685 INFO:tasks.ceph.mds.b.smithi130.stderr: -5075> 2024-09-10T21:06:01.691+0000 7eff6c000640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-10T21:06:57.688 INFO:tasks.ceph.mds.b.smithi130.stderr: -3734> 2024-09-10T21:06:12.690+0000 7eff64800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T21:06:57.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T21:06:57.739 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2024-09-10T21:06:57.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.853+0000 7fc906a00640 1 -- 172.21.15.100:0/1076352163 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc90015b4d0 msgr2=0x7fc90015ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.853+0000 7fc906a00640 1 --2- 172.21.15.100:0/1076352163 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc90015b4d0 0x7fc90015ea60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0005fd0 tx=0x7fc8f002ab20 comp rx=0 tx=0).stop 2024-09-10T21:06:57.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.853+0000 7fc906a00640 1 -- 172.21.15.100:0/1076352163 shutdown_connections 2024-09-10T21:06:57.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.853+0000 7fc906a00640 1 --2- 172.21.15.100:0/1076352163 >> v2:172.21.15.130:3300/0 conn(0x7fc9000cf810 0x7fc900161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.853+0000 7fc906a00640 1 --2- 172.21.15.100:0/1076352163 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc90015b4d0 0x7fc90015ea60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.853+0000 7fc906a00640 1 -- 172.21.15.100:0/1076352163 >> 172.21.15.100:0/1076352163 conn(0x7fc90006cb50 msgr2=0x7fc90006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:57.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.853+0000 7fc906a00640 1 -- 172.21.15.100:0/1076352163 shutdown_connections 2024-09-10T21:06:57.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.853+0000 7fc906a00640 1 -- 172.21.15.100:0/1076352163 wait complete. 2024-09-10T21:06:57.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.854+0000 7fc906a00640 1 Processor -- start 2024-09-10T21:06:57.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.855+0000 7fc906a00640 1 -- start start 2024-09-10T21:06:57.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.855+0000 7fc906a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc90006eb60 0x7fc9000b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.855+0000 7fc906a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9000cf810 0x7fc9001f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.855+0000 7fc906a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90015b4d0 0x7fc9000733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.855+0000 7fc906a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc90006f3d0 con 0x7fc90015b4d0 2024-09-10T21:06:57.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.855+0000 7fc906a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc90006f250 con 0x7fc9000cf810 2024-09-10T21:06:57.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.855+0000 7fc906a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc9000b3120 con 0x7fc90006eb60 2024-09-10T21:06:57.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc904a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90015b4d0 0x7fc9000733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9000cf810 0x7fc9001f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc8ffe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc90006eb60 0x7fc9000b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc904a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90015b4d0 0x7fc9000733f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54032/0 (socket says 172.21.15.100:54032) 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9000cf810 0x7fc9001f8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:58190/0 (socket says 172.21.15.100:58190) 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc904a00640 1 -- 172.21.15.100:0/3023067019 learned_addr learned my addr 172.21.15.100:0/3023067019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc8ff400640 1 -- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc90006eb60 msgr2=0x7fc9000b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc8ff400640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc90006eb60 0x7fc9000b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc8ff400640 1 -- 172.21.15.100:0/3023067019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90015b4d0 msgr2=0x7fc9000733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc8ff400640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90015b4d0 0x7fc9000733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.856+0000 7fc8ff400640 1 -- 172.21.15.100:0/3023067019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9001f8950 con 0x7fc9000cf810 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.857+0000 7fc8ff400640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9000cf810 0x7fc9001f8410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc9000d0380 tx=0x7fc8ec00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.857+0000 7fc8f7e00640 1 -- 172.21.15.100:0/3023067019 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00cc40 con 0x7fc9000cf810 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.857+0000 7fc8f7e00640 1 -- 172.21.15.100:0/3023067019 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8ec00cde0 con 0x7fc9000cf810 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.857+0000 7fc8f7e00640 1 -- 172.21.15.100:0/3023067019 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec004280 con 0x7fc9000cf810 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.857+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc900157460 con 0x7fc9000cf810 2024-09-10T21:06:57.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.857+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9000b0410 con 0x7fc9000cf810 2024-09-10T21:06:57.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.858+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9000b35d0 con 0x7fc9000cf810 2024-09-10T21:06:57.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.859+0000 7fc8f7e00640 1 -- 172.21.15.100:0/3023067019 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc8ec0035f0 con 0x7fc9000cf810 2024-09-10T21:06:57.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.860+0000 7fc8f7e00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc8e0077f70 0x7fc8e007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:57.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.860+0000 7fc8f7e00640 1 -- 172.21.15.100:0/3023067019 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6792+0+0 (secure 0 0 0) 0x7fc8ec09aa90 con 0x7fc9000cf810 2024-09-10T21:06:57.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.861+0000 7fc8ffe00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc8e0077f70 0x7fc8e007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:57.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.861+0000 7fc8ffe00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc8e0077f70 0x7fc8e007a430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0035000 tx=0x7fc8f0038040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:57.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:57.865+0000 7fc8f7e00640 1 -- 172.21.15.100:0/3023067019 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc9001f8950 con 0x7fc9000cf810 2024-09-10T21:06:58.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.085+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc90006d180 con 0x7fc9000cf810 2024-09-10T21:06:58.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.679+0000 7fc8f7e00640 1 -- 172.21.15.100:0/3023067019 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fc8ec062af0 con 0x7fc9000cf810 2024-09-10T21:06:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc8e0077f70 msgr2=0x7fc8e007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc8e0077f70 0x7fc8e007a430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0035000 tx=0x7fc8f0038040 comp rx=0 tx=0).stop 2024-09-10T21:06:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9000cf810 msgr2=0x7fc9001f8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9000cf810 0x7fc9001f8410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc9000d0380 tx=0x7fc8ec00ee50 comp rx=0 tx=0).stop 2024-09-10T21:06:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 shutdown_connections 2024-09-10T21:06:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90015b4d0 0x7fc9000733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc8e0077f70 0x7fc8e007a430 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9000cf810 0x7fc9001f8410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 --2- 172.21.15.100:0/3023067019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc90006eb60 0x7fc9000b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 >> 172.21.15.100:0/3023067019 conn(0x7fc90006cb50 msgr2=0x7fc9000b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.681+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 shutdown_connections 2024-09-10T21:06:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.682+0000 7fc906a00640 1 -- 172.21.15.100:0/3023067019 wait complete. 2024-09-10T21:06:58.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T21:06:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.861+0000 7fd67ae00640 1 -- 172.21.15.100:0/1839741844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415b680 msgr2=0x7fd67415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.861+0000 7fd67ae00640 1 --2- 172.21.15.100:0/1839741844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415b680 0x7fd67415ba60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd6740cd2b0 tx=0x7fd66402a820 comp rx=0 tx=0).stop 2024-09-10T21:06:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.861+0000 7fd67ae00640 1 -- 172.21.15.100:0/1839741844 shutdown_connections 2024-09-10T21:06:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.861+0000 7fd67ae00640 1 --2- 172.21.15.100:0/1839741844 >> v2:172.21.15.130:3300/0 conn(0x7fd67415c750 0x7fd6740cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.861+0000 7fd67ae00640 1 --2- 172.21.15.100:0/1839741844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415b680 0x7fd67415ba60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.861+0000 7fd67ae00640 1 -- 172.21.15.100:0/1839741844 >> 172.21.15.100:0/1839741844 conn(0x7fd67406cb50 msgr2=0x7fd67406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.861+0000 7fd67ae00640 1 -- 172.21.15.100:0/1839741844 shutdown_connections 2024-09-10T21:06:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.861+0000 7fd67ae00640 1 -- 172.21.15.100:0/1839741844 wait complete. 2024-09-10T21:06:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.863+0000 7fd67ae00640 1 Processor -- start 2024-09-10T21:06:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.863+0000 7fd67ae00640 1 -- start start 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd67ae00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6740741e0 0x7fd67415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd67ae00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd67415b680 0x7fd67414bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd67ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415c750 0x7fd674158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd67ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740b2860 con 0x7fd67415c750 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd67ae00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740d00c0 con 0x7fd6740741e0 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd67ae00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd6740b29e0 con 0x7fd67415b680 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd678e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415c750 0x7fd674158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd678e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415c750 0x7fd674158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54054/0 (socket says 172.21.15.100:54054) 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd678e00640 1 -- 172.21.15.100:0/555193316 learned_addr learned my addr 172.21.15.100:0/555193316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd673e00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6740741e0 0x7fd67415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.864+0000 7fd673400640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd67415b680 0x7fd67414bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd678e00640 1 -- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd67415b680 msgr2=0x7fd67414bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd678e00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd67415b680 0x7fd67414bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd678e00640 1 -- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6740741e0 msgr2=0x7fd67415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd678e00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6740741e0 0x7fd67415a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd678e00640 1 -- 172.21.15.100:0/555193316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd674156580 con 0x7fd67415c750 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd678e00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415c750 0x7fd674158650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00d660 tx=0x7fd66c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd66be00640 1 -- 172.21.15.100:0/555193316 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c017070 con 0x7fd67415c750 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd66be00640 1 -- 172.21.15.100:0/555193316 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd66c005310 con 0x7fd67415c750 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd66be00640 1 -- 172.21.15.100:0/555193316 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c009820 con 0x7fd67415c750 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6741557c0 con 0x7fd67415c750 2024-09-10T21:06:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.865+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd674155d80 con 0x7fd67415c750 2024-09-10T21:06:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.866+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6740cc490 con 0x7fd67415c750 2024-09-10T21:06:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.867+0000 7fd66be00640 1 -- 172.21.15.100:0/555193316 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd66c0099c0 con 0x7fd67415c750 2024-09-10T21:06:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.868+0000 7fd66be00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd654077f70 0x7fd65407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.868+0000 7fd66be00640 1 -- 172.21.15.100:0/555193316 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6792+0+0 (secure 0 0 0) 0x7fd66c09a1f0 con 0x7fd67415c750 2024-09-10T21:06:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.869+0000 7fd673e00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd654077f70 0x7fd65407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.870+0000 7fd673e00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd654077f70 0x7fd65407a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd664034000 tx=0x7fd664004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:58.872+0000 7fd66be00640 1 -- 172.21.15.100:0/555193316 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd66c062250 con 0x7fd67415c750 2024-09-10T21:06:59.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.055+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd67406ab80 con 0x7fd67415c750 2024-09-10T21:06:59.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.782+0000 7fd66be00640 1 -- 172.21.15.100:0/555193316 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7fd66c066c80 con 0x7fd67415c750 2024-09-10T21:06:59.786 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-09-10T21:06:59.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd654077f70 msgr2=0x7fd65407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:59.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd654077f70 0x7fd65407a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd664034000 tx=0x7fd664004ab0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415c750 msgr2=0x7fd674158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415c750 0x7fd674158650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00d660 tx=0x7fd66c00db20 comp rx=0 tx=0).stop 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 shutdown_connections 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd67415c750 0x7fd674158650 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd67415b680 0x7fd67414bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd654077f70 0x7fd65407a430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 --2- 172.21.15.100:0/555193316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6740741e0 0x7fd67415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.786+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 >> 172.21.15.100:0/555193316 conn(0x7fd67406cb50 msgr2=0x7fd6740ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.787+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 shutdown_connections 2024-09-10T21:06:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.787+0000 7fd67ae00640 1 -- 172.21.15.100:0/555193316 wait complete. 2024-09-10T21:06:59.815 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T21:06:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.974+0000 7f02abc00640 1 -- 172.21.15.100:0/1401420617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a40741e0 msgr2=0x7f02a415f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.974+0000 7f02abc00640 1 --2- 172.21.15.100:0/1401420617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a40741e0 0x7f02a415f4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0290009830 tx=0x7f029002a510 comp rx=0 tx=0).stop 2024-09-10T21:06:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.974+0000 7f02abc00640 1 -- 172.21.15.100:0/1401420617 shutdown_connections 2024-09-10T21:06:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.974+0000 7f02abc00640 1 --2- 172.21.15.100:0/1401420617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a40741e0 0x7f02a415f4d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.974+0000 7f02abc00640 1 --2- 172.21.15.100:0/1401420617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02a415b680 0x7f02a415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.974+0000 7f02abc00640 1 -- 172.21.15.100:0/1401420617 >> 172.21.15.100:0/1401420617 conn(0x7f02a406cb50 msgr2=0x7f02a406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:59.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.974+0000 7f02abc00640 1 -- 172.21.15.100:0/1401420617 shutdown_connections 2024-09-10T21:06:59.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.974+0000 7f02abc00640 1 -- 172.21.15.100:0/1401420617 wait complete. 2024-09-10T21:06:59.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.976+0000 7f02abc00640 1 Processor -- start 2024-09-10T21:06:59.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.976+0000 7f02abc00640 1 -- start start 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02abc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02a40741e0 0x7f02a40c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02abc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02a415b680 0x7f02a41f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02abc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a415c750 0x7f02a4156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02abc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40b29e0 con 0x7f02a415c750 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02abc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40b2860 con 0x7f02a40741e0 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02abc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f02a40b2b60 con 0x7f02a415b680 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02a9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a415c750 0x7f02a4156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02a9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a415c750 0x7f02a4156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54058/0 (socket says 172.21.15.100:54058) 2024-09-10T21:06:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02a9c00640 1 -- 172.21.15.100:0/704023771 learned_addr learned my addr 172.21.15.100:0/704023771 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:06:59.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02a3e00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02a415b680 0x7f02a41f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02a9200640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02a40741e0 0x7f02a40c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.977+0000 7f02a9c00640 1 -- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02a415b680 msgr2=0x7f02a41f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a9c00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02a415b680 0x7f02a41f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a9c00640 1 -- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02a40741e0 msgr2=0x7f02a40c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a9c00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02a40741e0 0x7f02a40c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a9c00640 1 -- 172.21.15.100:0/704023771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a40c52a0 con 0x7f02a415c750 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a9200640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02a40741e0 0x7f02a40c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a9c00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a415c750 0x7f02a4156510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f029c00cb10 tx=0x7f029c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a0c00640 1 -- 172.21.15.100:0/704023771 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c016020 con 0x7f02a415c750 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a0c00640 1 -- 172.21.15.100:0/704023771 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f029c00ad80 con 0x7f02a415c750 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02a0c00640 1 -- 172.21.15.100:0/704023771 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c012680 con 0x7f02a415c750 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a40c5580 con 0x7f02a415c750 2024-09-10T21:06:59.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.978+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a4156a50 con 0x7f02a415c750 2024-09-10T21:06:59.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.979+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a40b3010 con 0x7f02a415c750 2024-09-10T21:06:59.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.980+0000 7f02a0c00640 1 -- 172.21.15.100:0/704023771 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f029c012820 con 0x7f02a415c750 2024-09-10T21:06:59.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.981+0000 7f02a0c00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0284077fa0 0x7f028407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:59.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.981+0000 7f02a0c00640 1 -- 172.21.15.100:0/704023771 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6354+0+0 (secure 0 0 0) 0x7f029c09a9a0 con 0x7f02a415c750 2024-09-10T21:06:59.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.982+0000 7f02a9200640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0284077fa0 0x7f028407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:59.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.982+0000 7f02a9200640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0284077fa0 0x7f028407a460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0294009b50 tx=0x7f0294005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:59.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:06:59.985+0000 7f02a0c00640 1 -- 172.21.15.100:0/704023771 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f029c020020 con 0x7f02a415c750 2024-09-10T21:07:00.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.168+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f02a40cc490 con 0x7f02a415c750 2024-09-10T21:07:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.787+0000 7f02a0c00640 1 -- 172.21.15.100:0/704023771 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f029c063170 con 0x7f02a415c750 2024-09-10T21:07:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-09-10T21:07:00.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.793+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0284077fa0 msgr2=0x7f028407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.793+0000 7f02abc00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0284077fa0 0x7f028407a460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0294009b50 tx=0x7f0294005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:00.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.793+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a415c750 msgr2=0x7f02a4156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.793+0000 7f02abc00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a415c750 0x7f02a4156510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f029c00cb10 tx=0x7f029c00a060 comp rx=0 tx=0).stop 2024-09-10T21:07:00.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.795+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 shutdown_connections 2024-09-10T21:07:00.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.795+0000 7f02abc00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02a415c750 0x7f02a4156510 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.795+0000 7f02abc00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02a415b680 0x7f02a41f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.795+0000 7f02abc00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0284077fa0 0x7f028407a460 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.795+0000 7f02abc00640 1 --2- 172.21.15.100:0/704023771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02a40741e0 0x7f02a40c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.795+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 >> 172.21.15.100:0/704023771 conn(0x7f02a406cb50 msgr2=0x7f02a40aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:00.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.795+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 shutdown_connections 2024-09-10T21:07:00.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.796+0000 7f02abc00640 1 -- 172.21.15.100:0/704023771 wait complete. 2024-09-10T21:07:00.819 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-10T21:07:00.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.986+0000 7ff4ad000640 1 -- 172.21.15.100:0/2831193127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff48c004800 msgr2=0x7ff48c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.986+0000 7ff4ad000640 1 --2- 172.21.15.100:0/2831193127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff48c004800 0x7ff48c004c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff494009b50 tx=0x7ff48c005830 comp rx=0 tx=0).stop 2024-09-10T21:07:00.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.986+0000 7ff4a6800640 1 -- 172.21.15.100:0/2831193127 reap_dead start 2024-09-10T21:07:00.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.986+0000 7ff4ad000640 1 -- 172.21.15.100:0/2831193127 shutdown_connections 2024-09-10T21:07:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.986+0000 7ff4ad000640 1 -- 172.21.15.100:0/2831193127 >> 172.21.15.100:0/2831193127 conn(0x7ff4a806cb50 msgr2=0x7ff4a806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.986+0000 7ff4ad000640 1 -- 172.21.15.100:0/2831193127 shutdown_connections 2024-09-10T21:07:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.986+0000 7ff4ad000640 1 -- 172.21.15.100:0/2831193127 wait complete. 2024-09-10T21:07:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.988+0000 7ff4ad000640 1 Processor -- start 2024-09-10T21:07:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.988+0000 7ff4ad000640 1 -- start start 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4ad000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff48c004800 0x7ff4a81480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4ad000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4a80c7240 0x7ff4a81f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4ad000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4a80c76a0 0x7ff4a81f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4ad000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a80b34b0 con 0x7ff4a80c7240 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4ad000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a80b3330 con 0x7ff4a80c76a0 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4ad000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a80b3630 con 0x7ff48c004800 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4a80c7240 0x7ff4a81f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4a80c7240 0x7ff4a81f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54078/0 (socket says 172.21.15.100:54078) 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5400640 1 -- 172.21.15.100:0/1265122988 learned_addr learned my addr 172.21.15.100:0/1265122988 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a6800640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4a80c76a0 0x7ff4a81f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5e00640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff48c004800 0x7ff4a81480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5400640 1 -- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff48c004800 msgr2=0x7ff4a81480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5400640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff48c004800 0x7ff4a81480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5400640 1 -- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4a80c76a0 msgr2=0x7ff4a81f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5400640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4a80c76a0 0x7ff4a81f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a5400640 1 -- 172.21.15.100:0/1265122988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a814ae30 con 0x7ff4a80c7240 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.989+0000 7ff4a6800640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4a80c76a0 0x7ff4a81f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.990+0000 7ff4a5400640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4a80c7240 0x7ff4a81f49d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff494036040 tx=0x7ff494033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.990+0000 7ff49e000640 1 -- 172.21.15.100:0/1265122988 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494043070 con 0x7ff4a80c7240 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.990+0000 7ff49e000640 1 -- 172.21.15.100:0/1265122988 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff494004320 con 0x7ff4a80c7240 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.990+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a80b0510 con 0x7ff4a80c7240 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.990+0000 7ff49e000640 1 -- 172.21.15.100:0/1265122988 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494038040 con 0x7ff4a80c7240 2024-09-10T21:07:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.990+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a80b0ad0 con 0x7ff4a80c7240 2024-09-10T21:07:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.991+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a8161930 con 0x7ff4a80c7240 2024-09-10T21:07:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.992+0000 7ff49e000640 1 -- 172.21.15.100:0/1265122988 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff49403b030 con 0x7ff4a80c7240 2024-09-10T21:07:00.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.993+0000 7ff49e000640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff488077f70 0x7ff48807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.994+0000 7ff49e000640 1 -- 172.21.15.100:0/1265122988 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5911+0+0 (secure 0 0 0) 0x7ff4940ba320 con 0x7ff4a80c7240 2024-09-10T21:07:00.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.994+0000 7ff4a5e00640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff488077f70 0x7ff48807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.995+0000 7ff4a5e00640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff488077f70 0x7ff48807a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff498000c00 tx=0x7ff498006b70 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:01.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:00.997+0000 7ff49e000640 1 -- 172.21.15.100:0/1265122988 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff4940826f0 con 0x7ff4a80c7240 2024-09-10T21:07:01.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.183+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4a815a2a0 con 0x7ff4a80c7240 2024-09-10T21:07:01.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.789+0000 7ff49e000640 1 -- 172.21.15.100:0/1265122988 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7ff494087120 con 0x7ff4a80c7240 2024-09-10T21:07:01.793 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_ec' removed 2024-09-10T21:07:01.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff488077f70 msgr2=0x7ff48807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:01.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff488077f70 0x7ff48807a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff498000c00 tx=0x7ff498006b70 comp rx=0 tx=0).stop 2024-09-10T21:07:01.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4a80c7240 msgr2=0x7ff4a81f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:01.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4a80c7240 0x7ff4a81f49d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff494036040 tx=0x7ff494033670 comp rx=0 tx=0).stop 2024-09-10T21:07:01.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 shutdown_connections 2024-09-10T21:07:01.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff488077f70 0x7ff48807a430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:01.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4a80c76a0 0x7ff4a81f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:01.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4a80c7240 0x7ff4a81f49d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:01.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 --2- 172.21.15.100:0/1265122988 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff48c004800 0x7ff4a81480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:01.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.793+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 >> 172.21.15.100:0/1265122988 conn(0x7ff4a806cb50 msgr2=0x7ff4a8073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:01.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.794+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 shutdown_connections 2024-09-10T21:07:01.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:01.794+0000 7ff4ad000640 1 -- 172.21.15.100:0/1265122988 wait complete. 2024-09-10T21:07:01.821 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T21:07:01.821 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T21:07:01.821 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T21:07:01.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:07:01.822 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T21:07:01.822 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T21:07:01.822 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T21:07:01.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:07:01.822 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T21:07:01.823 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T21:07:01.823 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T21:07:01.823 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:07:01.823 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T21:07:01.823 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T21:07:01.824 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T21:07:01.824 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:07:01.837 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T21:07:01.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T21:07:01.838 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T21:07:01.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T21:07:01.842 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T21:07:01.842 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T21:07:01.843 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T21:07:01.844 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T21:07:01.881 INFO:tasks.ceph.mds.a:Started 2024-09-10T21:07:01.882 DEBUG:teuthology.parallel:result is None 2024-09-10T21:07:01.884 INFO:tasks.ceph.mds.c:Started 2024-09-10T21:07:01.884 DEBUG:teuthology.parallel:result is None 2024-09-10T21:07:01.887 INFO:tasks.ceph.mds.d:Started 2024-09-10T21:07:01.887 DEBUG:teuthology.parallel:result is None 2024-09-10T21:07:01.889 INFO:tasks.ceph.mds.b:Started 2024-09-10T21:07:01.889 DEBUG:teuthology.parallel:result is None 2024-09-10T21:07:01.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T21:07:02.016 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-09-10T21:07:02.017 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-09-10T21:07:02.033 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2024-09-10T21:07:02.033 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2024-09-10T21:07:02.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.058+0000 7fe124800640 1 -- 172.21.15.100:0/2659603801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c15b680 msgr2=0x7fe11c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.058+0000 7fe124800640 1 --2- 172.21.15.100:0/2659603801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c15b680 0x7fe11c15ba60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe110009830 tx=0x7fe11002a480 comp rx=0 tx=0).stop 2024-09-10T21:07:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.058+0000 7fe124800640 1 -- 172.21.15.100:0/2659603801 shutdown_connections 2024-09-10T21:07:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.058+0000 7fe124800640 1 --2- 172.21.15.100:0/2659603801 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe11c0741e0 0x7fe11c15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.058+0000 7fe124800640 1 --2- 172.21.15.100:0/2659603801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c15b680 0x7fe11c15ba60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.058+0000 7fe124800640 1 -- 172.21.15.100:0/2659603801 >> 172.21.15.100:0/2659603801 conn(0x7fe11c06cb50 msgr2=0x7fe11c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.058+0000 7fe124800640 1 -- 172.21.15.100:0/2659603801 shutdown_connections 2024-09-10T21:07:02.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.058+0000 7fe124800640 1 -- 172.21.15.100:0/2659603801 wait complete. 2024-09-10T21:07:02.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.059+0000 7fe124800640 1 Processor -- start 2024-09-10T21:07:02.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.060+0000 7fe124800640 1 -- start start 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.060+0000 7fe124800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c0741e0 0x7fe11c1f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.060+0000 7fe124800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe11c15b680 0x7fe11c0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.060+0000 7fe124800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe11c15c750 0x7fe11c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.060+0000 7fe124800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c0b29e0 con 0x7fe11c0741e0 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.060+0000 7fe124800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c0b2860 con 0x7fe11c15c750 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.060+0000 7fe124800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe11c0b2b60 con 0x7fe11c15b680 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c0741e0 0x7fe11c1f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c0741e0 0x7fe11c1f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57978/0 (socket says 172.21.15.100:57978) 2024-09-10T21:07:02.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121e00640 1 -- 172.21.15.100:0/3444864824 learned_addr learned my addr 172.21.15.100:0/3444864824 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:02.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121400640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe11c15b680 0x7fe11c0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:02.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe122800640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe11c15c750 0x7fe11c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:02.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121e00640 1 -- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe11c15b680 msgr2=0x7fe11c0b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121e00640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe11c15b680 0x7fe11c0b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121e00640 1 -- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe11c15c750 msgr2=0x7fe11c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121e00640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe11c15c750 0x7fe11c158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.061+0000 7fe121e00640 1 -- 172.21.15.100:0/3444864824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c1f5580 con 0x7fe11c0741e0 2024-09-10T21:07:02.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.062+0000 7fe121e00640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c0741e0 0x7fe11c1f5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe110000c00 tx=0x7fe110032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:02.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.062+0000 7fe116000640 1 -- 172.21.15.100:0/3444864824 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110040070 con 0x7fe11c0741e0 2024-09-10T21:07:02.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.062+0000 7fe116000640 1 -- 172.21.15.100:0/3444864824 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1100038e0 con 0x7fe11c0741e0 2024-09-10T21:07:02.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.062+0000 7fe116000640 1 -- 172.21.15.100:0/3444864824 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110003d30 con 0x7fe11c0741e0 2024-09-10T21:07:02.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.062+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11c1e5e50 con 0x7fe11c0741e0 2024-09-10T21:07:02.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.062+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11c157b20 con 0x7fe11c0741e0 2024-09-10T21:07:02.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.063+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe11c0b3010 con 0x7fe11c0741e0 2024-09-10T21:07:02.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.064+0000 7fe116000640 1 -- 172.21.15.100:0/3444864824 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe110045670 con 0x7fe11c0741e0 2024-09-10T21:07:02.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.066+0000 7fe116000640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe100077f70 0x7fe10007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:02.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.066+0000 7fe116000640 1 -- 172.21.15.100:0/3444864824 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5335+0+0 (secure 0 0 0) 0x7fe1100bb530 con 0x7fe11c0741e0 2024-09-10T21:07:02.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.066+0000 7fe121400640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe100077f70 0x7fe10007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:02.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.067+0000 7fe121400640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe100077f70 0x7fe10007a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0b1830 tx=0x7fe10c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:02.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.070+0000 7fe116000640 1 -- 172.21.15.100:0/3444864824 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe11c1e5e50 con 0x7fe11c0741e0 2024-09-10T21:07:02.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:07:02.122 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:07:02.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.271+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe11c15f600 con 0x7fe11c0741e0 2024-09-10T21:07:02.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.811+0000 7fe116000640 1 -- 172.21.15.100:0/3444864824 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7fe11c1f5580 con 0x7fe11c0741e0 2024-09-10T21:07:02.816 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-09-10T21:07:02.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe100077f70 msgr2=0x7fe10007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe100077f70 0x7fe10007a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0b1830 tx=0x7fe10c005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c0741e0 msgr2=0x7fe11c1f5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c0741e0 0x7fe11c1f5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe110000c00 tx=0x7fe110032c10 comp rx=0 tx=0).stop 2024-09-10T21:07:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 shutdown_connections 2024-09-10T21:07:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe100077f70 0x7fe10007a430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe11c15c750 0x7fe11c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe11c15b680 0x7fe11c0b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 --2- 172.21.15.100:0/3444864824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c0741e0 0x7fe11c1f5040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 >> 172.21.15.100:0/3444864824 conn(0x7fe11c06cb50 msgr2=0x7fe11c0cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:02.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 shutdown_connections 2024-09-10T21:07:02.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.814+0000 7fe124800640 1 -- 172.21.15.100:0/3444864824 wait complete. 2024-09-10T21:07:02.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T21:07:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.993+0000 7f8aa9c00640 1 -- 172.21.15.100:0/3671628368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a88004800 msgr2=0x7f8a88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.993+0000 7f8aa9c00640 1 --2- 172.21.15.100:0/3671628368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a88004800 0x7f8a88004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009b20 tx=0x7f8a88005830 comp rx=0 tx=0).stop 2024-09-10T21:07:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.993+0000 7f8aa9200640 1 -- 172.21.15.100:0/3671628368 reap_dead start 2024-09-10T21:07:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.993+0000 7f8aa9c00640 1 -- 172.21.15.100:0/3671628368 shutdown_connections 2024-09-10T21:07:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.993+0000 7f8aa9c00640 1 -- 172.21.15.100:0/3671628368 >> 172.21.15.100:0/3671628368 conn(0x7f8aa406d500 msgr2=0x7f8aa40b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.993+0000 7f8aa9c00640 1 -- 172.21.15.100:0/3671628368 shutdown_connections 2024-09-10T21:07:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.993+0000 7f8aa9c00640 1 -- 172.21.15.100:0/3671628368 wait complete. 2024-09-10T21:07:02.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.995+0000 7f8aa9c00640 1 Processor -- start 2024-09-10T21:07:02.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.995+0000 7f8aa9c00640 1 -- start start 2024-09-10T21:07:03.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa9c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a88004800 0x7f8aa4149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa40b51d0 0x7f8aa41f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa9c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8aa4154660 0x7f8aa41f7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa9c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa406e3d0 con 0x7f8aa40b51d0 2024-09-10T21:07:03.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa9c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa406e250 con 0x7f8a88004800 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa9c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa406e550 con 0x7f8aa4154660 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8a9be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa40b51d0 0x7f8aa41f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8a9be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa40b51d0 0x7f8aa41f13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57984/0 (socket says 172.21.15.100:57984) 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8a9be00640 1 -- 172.21.15.100:0/168412337 learned_addr learned my addr 172.21.15.100:0/168412337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa3e00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a88004800 0x7f8aa4149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa9200640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8aa4154660 0x7f8aa41f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8a9be00640 1 -- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8aa4154660 msgr2=0x7f8aa41f7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8a9be00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8aa4154660 0x7f8aa41f7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8a9be00640 1 -- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a88004800 msgr2=0x7f8aa4149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8a9be00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a88004800 0x7f8aa4149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8a9be00640 1 -- 172.21.15.100:0/168412337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa41f8430 con 0x7f8aa40b51d0 2024-09-10T21:07:03.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.996+0000 7f8aa9200640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8aa4154660 0x7f8aa41f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:03.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.997+0000 7f8a9be00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa40b51d0 0x7f8aa41f13a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009a70 tx=0x7f8a8c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:03.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.997+0000 7f8aa0c00640 1 -- 172.21.15.100:0/168412337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c043070 con 0x7f8aa40b51d0 2024-09-10T21:07:03.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.997+0000 7f8aa0c00640 1 -- 172.21.15.100:0/168412337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a8c004340 con 0x7f8aa40b51d0 2024-09-10T21:07:03.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.997+0000 7f8aa0c00640 1 -- 172.21.15.100:0/168412337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c038040 con 0x7f8aa40b51d0 2024-09-10T21:07:03.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.997+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa415be90 con 0x7f8aa40b51d0 2024-09-10T21:07:03.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.997+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa415c450 con 0x7f8aa40b51d0 2024-09-10T21:07:03.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.998+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa40cc130 con 0x7f8aa40b51d0 2024-09-10T21:07:03.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:02.999+0000 7f8aa0c00640 1 -- 172.21.15.100:0/168412337 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8a8c03b030 con 0x7f8aa40b51d0 2024-09-10T21:07:03.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.000+0000 7f8aa0c00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8a80077fa0 0x7f8a8007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.000+0000 7f8aa0c00640 1 -- 172.21.15.100:0/168412337 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f8a8c0b9d10 con 0x7f8aa40b51d0 2024-09-10T21:07:03.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.001+0000 7f8aa3e00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8a80077fa0 0x7f8a8007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.001+0000 7f8aa3e00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8a80077fa0 0x7f8a8007a460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a94001160 tx=0x7f8a94006040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.005+0000 7f8aa0c00640 1 -- 172.21.15.100:0/168412337 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8a8c0bf020 con 0x7f8aa40b51d0 2024-09-10T21:07:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.263+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8aa40b1670 con 0x7f8aa40b51d0 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.264+0000 7f8aa0c00640 1 -- 172.21.15.100:0/168412337 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f8aa41f8430 con 0x7f8aa40b51d0 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCBtOBm91YfCBAAJuQU3vTj6NDAS79wnMTRvg==", 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.269 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCBtOBmQeXDGxAAvPmL7yT75FSOxR5oiJBzyw==", 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.270 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCBtOBmgcrhERAAO2cvVbfzenrSfeNN10k1Gg==", 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-09-10T21:07:03.271 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCBtOBmgLeIJRAA5p1iud1IbSMCy4qrVJeXoA==", 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCEtOBmqN8EOxAAFD8DdBAhlxn+wHTxNFHqCg==", 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-09-10T21:07:03.272 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCItOBmLHTkCRAAQkyehe+jK3Nl9eNCyPVGwg==", 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.273 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCLtOBmXvevExAAKvSylSs/T/RLeUUg6sFpQA==", 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCOtOBmxD19HRAA5/CNRhr7PVJovwbTUJ5P+g==", 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.274 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCUtOBm7IiuGRAAPTBvPcz/MVGaN9bZ7Olaiw==", 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCXtOBm1hBTIxAA3QNXf0whNBdat8tpsEhiyg==", 2024-09-10T21:07:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCatOBmWN7lLBAACDaIR2pwIBHTk2D2DcxkpQ==", 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCdtOBmNvUVOBAAMlTy+S1hKSdWT1E0/QuPmQ==", 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCBtOBmKe35LRAA/ypsjneLjq8SDPXWynEDQw==", 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.277 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCBtOBmO5rsOhAAC8hEhtjNT9/IFDrWMaMe6A==", 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-09-10T21:07:03.278 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.2", 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCBtOBmacJtNBAAb0YQ3rXAS1ABoMXN4y0xoA==", 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.3", 2024-09-10T21:07:03.279 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCCtOBmBfXHBRAABuclnXQOigqnoLze1rkrAw==", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCAtOBmvSqZFBAA/0Axz7cM92cGrzlUBINCJw==", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-09-10T21:07:03.280 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mds", 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCltOBmtPD+IBAABtHG6CMV9JXr0RRO7MIyFA==", 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCltOBmWvv+IBAACJMbrWGtHvrkPhTTKTwlJQ==", 2024-09-10T21:07:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-osd", 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCltOBmtwP/IBAA6VRidgszrtyJK3LsVcKYdg==", 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCltOBmswv/IBAAx1/q+Wb68mpmuy83CjxCiQ==", 2024-09-10T21:07:03.282 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCltOBmIBT/IBAAp+RQ+45IDVHX7QTE2PBD2Q==", 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCltOBmXhz/IBAACNnzBwWHLEdmQdcRY04FhQ==", 2024-09-10T21:07:03.283 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCBtOBmsY1/ARAAIwtbNAaOYqOu1yYJg5RGkQ==", 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:03.284 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCAtOBmnUJZNhAA3FfByeaPqqDV3QVkKICf7Q==", 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-10T21:07:03.285 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.266+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8a80077fa0 msgr2=0x7f8a8007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.266+0000 7f8aa9c00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8a80077fa0 0x7f8a8007a460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a94001160 tx=0x7f8a94006040 comp rx=0 tx=0).stop 2024-09-10T21:07:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.266+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa40b51d0 msgr2=0x7f8aa41f13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.266+0000 7f8aa9c00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa40b51d0 0x7f8aa41f13a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009a70 tx=0x7f8a8c033670 comp rx=0 tx=0).stop 2024-09-10T21:07:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.267+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 shutdown_connections 2024-09-10T21:07:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.267+0000 7f8aa9c00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8aa4154660 0x7f8aa41f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.267+0000 7f8aa9c00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa40b51d0 0x7f8aa41f13a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.267+0000 7f8aa9c00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8a80077fa0 0x7f8a8007a460 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.267+0000 7f8aa9c00640 1 --2- 172.21.15.100:0/168412337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a88004800 0x7f8aa4149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.267+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 >> 172.21.15.100:0/168412337 conn(0x7f8aa406d500 msgr2=0x7f8aa40caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.267+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 shutdown_connections 2024-09-10T21:07:03.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.267+0000 7f8aa9c00640 1 -- 172.21.15.100:0/168412337 wait complete. 2024-09-10T21:07:03.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T21:07:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.444+0000 7f49e5e00640 1 -- 172.21.15.100:0/3321100616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 msgr2=0x7f49e00d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.444+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3321100616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 0x7f49e00d0730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f49d8005fd0 tx=0x7f49d802a8b0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.444+0000 7f49e5e00640 1 -- 172.21.15.100:0/3321100616 shutdown_connections 2024-09-10T21:07:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.444+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3321100616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 0x7f49e00d0730 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.444+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3321100616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49e00d24d0 0x7f49e00d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.444+0000 7f49e5e00640 1 -- 172.21.15.100:0/3321100616 >> 172.21.15.100:0/3321100616 conn(0x7f49e00d3a40 msgr2=0x7f49e00d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:03.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.444+0000 7f49e5e00640 1 -- 172.21.15.100:0/3321100616 shutdown_connections 2024-09-10T21:07:03.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.444+0000 7f49e5e00640 1 -- 172.21.15.100:0/3321100616 wait complete. 2024-09-10T21:07:03.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.446+0000 7f49e5e00640 1 Processor -- start 2024-09-10T21:07:03.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.446+0000 7f49e5e00640 1 -- start start 2024-09-10T21:07:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 0x7f49e0159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e5e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e015db30 0x7f49e00c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e5e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49e00c7370 0x7f49e00b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e5e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00b35b0 con 0x7f49e00d4560 2024-09-10T21:07:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e5e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00750e0 con 0x7f49e015db30 2024-09-10T21:07:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e5e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f49e00b3730 con 0x7f49e00c7370 2024-09-10T21:07:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 0x7f49e0159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 0x7f49e0159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57994/0 (socket says 172.21.15.100:57994) 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e5400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49e00c7370 0x7f49e00b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49e4a00640 1 -- 172.21.15.100:0/3566376552 learned_addr learned my addr 172.21.15.100:0/3566376552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.447+0000 7f49d7e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e015db30 0x7f49e00c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49e4a00640 1 -- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49e00c7370 msgr2=0x7f49e00b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49e4a00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49e00c7370 0x7f49e00b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49e4a00640 1 -- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e015db30 msgr2=0x7f49e00c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49e4a00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e015db30 0x7f49e00c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49e4a00640 1 -- 172.21.15.100:0/3566376552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e00ca360 con 0x7f49e00d4560 2024-09-10T21:07:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49e4a00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 0x7f49e0159fb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f49d000c430 tx=0x7f49d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49dd600640 1 -- 172.21.15.100:0/3566376552 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0011790 con 0x7f49e00d4560 2024-09-10T21:07:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49dd600640 1 -- 172.21.15.100:0/3566376552 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49d0017070 con 0x7f49e00d4560 2024-09-10T21:07:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e00cac40 con 0x7f49e00d4560 2024-09-10T21:07:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49dd600640 1 -- 172.21.15.100:0/3566376552 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0011ce0 con 0x7f49e00d4560 2024-09-10T21:07:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.448+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e00c9dc0 con 0x7f49e00d4560 2024-09-10T21:07:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.450+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e00b3be0 con 0x7f49e00d4560 2024-09-10T21:07:03.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.452+0000 7f49dd600640 1 -- 172.21.15.100:0/3566376552 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f49d001c460 con 0x7f49e00d4560 2024-09-10T21:07:03.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.453+0000 7f49dd600640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f49bc077fa0 0x7f49bc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.453+0000 7f49dd600640 1 -- 172.21.15.100:0/3566376552 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f49d0099790 con 0x7f49e00d4560 2024-09-10T21:07:03.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.454+0000 7f49d7e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f49bc077fa0 0x7f49bc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.454+0000 7f49d7e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f49bc077fa0 0x7f49bc07a460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f49e00b2c10 tx=0x7f49c800b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:03.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.458+0000 7f49dd600640 1 -- 172.21.15.100:0/3566376552 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f49d0061df0 con 0x7f49e00d4560 2024-09-10T21:07:03.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.715+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f49e00b99c0 con 0x7f49e00d4560 2024-09-10T21:07:03.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.717+0000 7f49dd600640 1 -- 172.21.15.100:0/3566376552 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f49d0066820 con 0x7f49e00d4560 2024-09-10T21:07:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f49bc077fa0 msgr2=0x7f49bc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f49bc077fa0 0x7f49bc07a460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f49e00b2c10 tx=0x7f49c800b390 comp rx=0 tx=0).stop 2024-09-10T21:07:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 msgr2=0x7f49e0159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 0x7f49e0159fb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f49d000c430 tx=0x7f49d000c8f0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 shutdown_connections 2024-09-10T21:07:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49e00c7370 0x7f49e00b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f49bc077fa0 0x7f49bc07a460 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49e015db30 0x7f49e00c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 --2- 172.21.15.100:0/3566376552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e00d4560 0x7f49e0159fb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 >> 172.21.15.100:0/3566376552 conn(0x7f49e00d3a40 msgr2=0x7f49e00b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 shutdown_connections 2024-09-10T21:07:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.720+0000 7f49e5e00640 1 -- 172.21.15.100:0/3566376552 wait complete. 2024-09-10T21:07:03.741 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T21:07:03.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.894+0000 7f5427c00640 1 -- 172.21.15.100:0/1861318038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 msgr2=0x7f542015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.894+0000 7f5427c00640 1 --2- 172.21.15.100:0/1861318038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 0x7f542015ba60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5410009830 tx=0x7f541002a480 comp rx=0 tx=0).stop 2024-09-10T21:07:03.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.894+0000 7f5427c00640 1 -- 172.21.15.100:0/1861318038 shutdown_connections 2024-09-10T21:07:03.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.894+0000 7f5427c00640 1 --2- 172.21.15.100:0/1861318038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 0x7f542015ba60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.894+0000 7f5427c00640 1 -- 172.21.15.100:0/1861318038 >> 172.21.15.100:0/1861318038 conn(0x7f542006cb50 msgr2=0x7f542006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:03.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.894+0000 7f5427c00640 1 -- 172.21.15.100:0/1861318038 shutdown_connections 2024-09-10T21:07:03.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.894+0000 7f5427c00640 1 -- 172.21.15.100:0/1861318038 wait complete. 2024-09-10T21:07:03.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.896+0000 7f5427c00640 1 Processor -- start 2024-09-10T21:07:03.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.896+0000 7f5427c00640 1 -- start start 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f5427c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54200741e0 0x7f54200ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f5427c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 0x7f542006e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f5427c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015c750 0x7f542006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f5427c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54200b2bf0 con 0x7f542015b680 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f5427c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54200b2a70 con 0x7f542015c750 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f5427c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f54200b2d70 con 0x7f54200741e0 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f541fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 0x7f542006e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f541fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 0x7f542006e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58014/0 (socket says 172.21.15.100:58014) 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f541fe00640 1 -- 172.21.15.100:0/2741875273 learned_addr learned my addr 172.21.15.100:0/2741875273 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f5425200640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54200741e0 0x7f54200ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.897+0000 7f5425c00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015c750 0x7f542006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541fe00640 1 -- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54200741e0 msgr2=0x7f54200ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541fe00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54200741e0 0x7f54200ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541fe00640 1 -- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015c750 msgr2=0x7f542006e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541fe00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015c750 0x7f542006e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541fe00640 1 -- 172.21.15.100:0/2741875273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54200ade50 con 0x7f542015b680 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541fe00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 0x7f542006e470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c460 tx=0x7f540c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541cc00640 1 -- 172.21.15.100:0/2741875273 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c016020 con 0x7f542015b680 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541cc00640 1 -- 172.21.15.100:0/2741875273 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f540c012960 con 0x7f542015b680 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f541cc00640 1 -- 172.21.15.100:0/2741875273 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c012db0 con 0x7f542015b680 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54200ae130 con 0x7f542015b680 2024-09-10T21:07:03.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.898+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54200ae6f0 con 0x7f542015b680 2024-09-10T21:07:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.900+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542015f4d0 con 0x7f542015b680 2024-09-10T21:07:03.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.901+0000 7f541cc00640 1 -- 172.21.15.100:0/2741875273 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f540c01a3b0 con 0x7f542015b680 2024-09-10T21:07:03.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.902+0000 7f541cc00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5400077f70 0x7f540007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:03.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.902+0000 7f541cc00640 1 -- 172.21.15.100:0/2741875273 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f540c099a50 con 0x7f542015b680 2024-09-10T21:07:03.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.902+0000 7f5425200640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5400077f70 0x7f540007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:03.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.902+0000 7f5425200640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5400077f70 0x7f540007a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5410034000 tx=0x7f5410004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:03.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:03.906+0000 7f541cc00640 1 -- 172.21.15.100:0/2741875273 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f540c020030 con 0x7f542015b680 2024-09-10T21:07:04.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.156+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f54200cc490 con 0x7f542015b680 2024-09-10T21:07:04.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.159+0000 7f541cc00640 1 -- 172.21.15.100:0/2741875273 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f540c0620c0 con 0x7f542015b680 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5400077f70 msgr2=0x7f540007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5400077f70 0x7f540007a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5410034000 tx=0x7f5410004730 comp rx=0 tx=0).stop 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 msgr2=0x7f542006e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 0x7f542006e470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c460 tx=0x7f540c00c920 comp rx=0 tx=0).stop 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 shutdown_connections 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5400077f70 0x7f540007a430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f542015c750 0x7f542006e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f542015b680 0x7f542006e470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 --2- 172.21.15.100:0/2741875273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54200741e0 0x7f54200ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 >> 172.21.15.100:0/2741875273 conn(0x7f542006cb50 msgr2=0x7f54200b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 shutdown_connections 2024-09-10T21:07:04.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.162+0000 7f5427c00640 1 -- 172.21.15.100:0/2741875273 wait complete. 2024-09-10T21:07:04.181 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T21:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.333+0000 7f69ee800640 1 -- 172.21.15.100:0/388829053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e80741e0 msgr2=0x7f69e815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.333+0000 7f69ee800640 1 --2- 172.21.15.100:0/388829053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e80741e0 0x7f69e815f4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f69e8070770 tx=0x7f69d402a5f0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.333+0000 7f69ee800640 1 -- 172.21.15.100:0/388829053 shutdown_connections 2024-09-10T21:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.333+0000 7f69ee800640 1 --2- 172.21.15.100:0/388829053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e80741e0 0x7f69e815f4d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.333+0000 7f69ee800640 1 --2- 172.21.15.100:0/388829053 >> v2:172.21.15.130:3300/0 conn(0x7f69e815b680 0x7f69e815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.333+0000 7f69ee800640 1 -- 172.21.15.100:0/388829053 >> 172.21.15.100:0/388829053 conn(0x7f69e806cb50 msgr2=0x7f69e806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.333+0000 7f69ee800640 1 -- 172.21.15.100:0/388829053 shutdown_connections 2024-09-10T21:07:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.333+0000 7f69ee800640 1 -- 172.21.15.100:0/388829053 wait complete. 2024-09-10T21:07:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.335+0000 7f69ee800640 1 Processor -- start 2024-09-10T21:07:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.335+0000 7f69ee800640 1 -- start start 2024-09-10T21:07:04.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69ee800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e80741e0 0x7f69e80afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69ee800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e815b680 0x7f69e814c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69ee800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e815c750 0x7f69e814e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69ee800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69e80b2860 con 0x7f69e815b680 2024-09-10T21:07:04.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69ee800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69e815cf00 con 0x7f69e80741e0 2024-09-10T21:07:04.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69ee800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f69e80b29e0 con 0x7f69e815c750 2024-09-10T21:07:04.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69e6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e815b680 0x7f69e814c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69e6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e815b680 0x7f69e814c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58028/0 (socket says 172.21.15.100:58028) 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69e6a00640 1 -- 172.21.15.100:0/676030935 learned_addr learned my addr 172.21.15.100:0/676030935 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69e7400640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e80741e0 0x7f69e80afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.336+0000 7f69e7e00640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e815c750 0x7f69e814e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69e6a00640 1 -- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e815c750 msgr2=0x7f69e814e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69e6a00640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e815c750 0x7f69e814e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69e6a00640 1 -- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e80741e0 msgr2=0x7f69e80afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69e6a00640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e80741e0 0x7f69e80afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69e6a00640 1 -- 172.21.15.100:0/676030935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e814c6c0 con 0x7f69e815b680 2024-09-10T21:07:04.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69e7400640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e80741e0 0x7f69e80afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:07:04.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69e6a00640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e815b680 0x7f69e814c070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000c00 tx=0x7f69d4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69df400640 1 -- 172.21.15.100:0/676030935 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d403f070 con 0x7f69e815b680 2024-09-10T21:07:04.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69df400640 1 -- 172.21.15.100:0/676030935 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69d40047a0 con 0x7f69e815b680 2024-09-10T21:07:04.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69df400640 1 -- 172.21.15.100:0/676030935 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4035030 con 0x7f69e815b680 2024-09-10T21:07:04.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e814c9a0 con 0x7f69e815b680 2024-09-10T21:07:04.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.337+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e814cf60 con 0x7f69e815b680 2024-09-10T21:07:04.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.338+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e815f4d0 con 0x7f69e815b680 2024-09-10T21:07:04.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.339+0000 7f69df400640 1 -- 172.21.15.100:0/676030935 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f69d4004bb0 con 0x7f69e815b680 2024-09-10T21:07:04.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.340+0000 7f69df400640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69c8077f70 0x7f69c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.340+0000 7f69df400640 1 -- 172.21.15.100:0/676030935 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f69d40bab70 con 0x7f69e815b680 2024-09-10T21:07:04.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.341+0000 7f69e7400640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69c8077f70 0x7f69c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.342+0000 7f69e7400640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69c8077f70 0x7f69c807a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009fc0 tx=0x7f69d8005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.344+0000 7f69df400640 1 -- 172.21.15.100:0/676030935 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f69d4083270 con 0x7f69e815b680 2024-09-10T21:07:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.597+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f69e80cf820 con 0x7f69e815b680 2024-09-10T21:07:04.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.600+0000 7f69df400640 1 -- 172.21.15.100:0/676030935 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f69d4087ca0 con 0x7f69e815b680 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69c8077f70 msgr2=0x7f69c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69c8077f70 0x7f69c807a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009fc0 tx=0x7f69d8005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e815b680 msgr2=0x7f69e814c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e815b680 0x7f69e814c070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000c00 tx=0x7f69d4003820 comp rx=0 tx=0).stop 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 shutdown_connections 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e815c750 0x7f69e814e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e815b680 0x7f69e814c070 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69c8077f70 0x7f69c807a430 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 --2- 172.21.15.100:0/676030935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e80741e0 0x7f69e80afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 >> 172.21.15.100:0/676030935 conn(0x7f69e806cb50 msgr2=0x7f69e80ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 shutdown_connections 2024-09-10T21:07:04.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.602+0000 7f69ee800640 1 -- 172.21.15.100:0/676030935 wait complete. 2024-09-10T21:07:04.622 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T21:07:04.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.775+0000 7f6bd6400640 1 -- 172.21.15.100:0/3846544698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd015b680 msgr2=0x7f6bd015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.775+0000 7f6bd6400640 1 --2- 172.21.15.100:0/3846544698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd015b680 0x7f6bd015ba60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009830 tx=0x7f6bc002a480 comp rx=0 tx=0).stop 2024-09-10T21:07:04.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.775+0000 7f6bd6400640 1 -- 172.21.15.100:0/3846544698 shutdown_connections 2024-09-10T21:07:04.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.775+0000 7f6bd6400640 1 --2- 172.21.15.100:0/3846544698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bd015c750 0x7f6bd00cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.775+0000 7f6bd6400640 1 --2- 172.21.15.100:0/3846544698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd015b680 0x7f6bd015ba60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.775+0000 7f6bd6400640 1 -- 172.21.15.100:0/3846544698 >> 172.21.15.100:0/3846544698 conn(0x7f6bd006cb50 msgr2=0x7f6bd006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.775+0000 7f6bd6400640 1 -- 172.21.15.100:0/3846544698 shutdown_connections 2024-09-10T21:07:04.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.775+0000 7f6bd6400640 1 -- 172.21.15.100:0/3846544698 wait complete. 2024-09-10T21:07:04.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.777+0000 7f6bd6400640 1 Processor -- start 2024-09-10T21:07:04.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.777+0000 7f6bd6400640 1 -- start start 2024-09-10T21:07:04.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bd6400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00741e0 0x7f6bd0153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bd6400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bd015b680 0x7f6bd01f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bd6400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bd015c750 0x7f6bd01f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bd6400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd00b29e0 con 0x7f6bd00741e0 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bd6400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd00b2860 con 0x7f6bd015c750 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bd6400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd00b2b60 con 0x7f6bd015b680 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bcf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00741e0 0x7f6bd0153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bcf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00741e0 0x7f6bd0153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58034/0 (socket says 172.21.15.100:58034) 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bcf400640 1 -- 172.21.15.100:0/1771768952 learned_addr learned my addr 172.21.15.100:0/1771768952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.778+0000 7f6bcea00640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bd015b680 0x7f6bd01f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bcfe00640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bd015c750 0x7f6bd01f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bcf400640 1 -- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bd015b680 msgr2=0x7f6bd01f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bcf400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bd015b680 0x7f6bd01f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bcf400640 1 -- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bd015c750 msgr2=0x7f6bd01f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bcf400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bd015c750 0x7f6bd01f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bcf400640 1 -- 172.21.15.100:0/1771768952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd01f8910 con 0x7f6bd00741e0 2024-09-10T21:07:04.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bcfe00640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bd015c750 0x7f6bd01f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:04.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bcf400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00741e0 0x7f6bd0153bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0000c00 tx=0x7f6bc0032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bc7400640 1 -- 172.21.15.100:0/1771768952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0040070 con 0x7f6bd00741e0 2024-09-10T21:07:04.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bc7400640 1 -- 172.21.15.100:0/1771768952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bc00038e0 con 0x7f6bd00741e0 2024-09-10T21:07:04.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bc7400640 1 -- 172.21.15.100:0/1771768952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0003d30 con 0x7f6bd00741e0 2024-09-10T21:07:04.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd0157bc0 con 0x7f6bd00741e0 2024-09-10T21:07:04.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.779+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd0158180 con 0x7f6bd00741e0 2024-09-10T21:07:04.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.780+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd00b3010 con 0x7f6bd00741e0 2024-09-10T21:07:04.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.781+0000 7f6bc7400640 1 -- 172.21.15.100:0/1771768952 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6bc0045460 con 0x7f6bd00741e0 2024-09-10T21:07:04.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.782+0000 7f6bc7400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6bb0077fa0 0x7f6bb007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.782+0000 7f6bc7400640 1 -- 172.21.15.100:0/1771768952 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f6bc00bb290 con 0x7f6bd00741e0 2024-09-10T21:07:04.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.783+0000 7f6bcea00640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6bb0077fa0 0x7f6bb007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.783+0000 7f6bcea00640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6bb0077fa0 0x7f6bb007a460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc007fd0 tx=0x7f6bbc001410 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:04.786+0000 7f6bc7400640 1 -- 172.21.15.100:0/1771768952 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6bc0083f40 con 0x7f6bd00741e0 2024-09-10T21:07:05.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.041+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f6bd015bb70 con 0x7f6bd00741e0 2024-09-10T21:07:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.044+0000 7f6bc7400640 1 -- 172.21.15.100:0/1771768952 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f6bc0083840 con 0x7f6bd00741e0 2024-09-10T21:07:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6bb0077fa0 msgr2=0x7f6bb007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6bb0077fa0 0x7f6bb007a460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc007fd0 tx=0x7f6bbc001410 comp rx=0 tx=0).stop 2024-09-10T21:07:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00741e0 msgr2=0x7f6bd0153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00741e0 0x7f6bd0153bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0000c00 tx=0x7f6bc0032c10 comp rx=0 tx=0).stop 2024-09-10T21:07:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 shutdown_connections 2024-09-10T21:07:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f6bb0077fa0 0x7f6bb007a460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bd015c750 0x7f6bd01f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bd015b680 0x7f6bd01f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 --2- 172.21.15.100:0/1771768952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00741e0 0x7f6bd0153bc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 >> 172.21.15.100:0/1771768952 conn(0x7f6bd006cb50 msgr2=0x7f6bd00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.046+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 shutdown_connections 2024-09-10T21:07:05.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.047+0000 7f6bd6400640 1 -- 172.21.15.100:0/1771768952 wait complete. 2024-09-10T21:07:05.066 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T21:07:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.221+0000 7f335ac00640 1 -- 172.21.15.100:0/1969113972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 msgr2=0x7f3338004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.221+0000 7f335ac00640 1 --2- 172.21.15.100:0/1969113972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 0x7f3338004060 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3344001830 tx=0x7f3338005830 comp rx=0 tx=0).stop 2024-09-10T21:07:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.221+0000 7f3358c00640 1 -- 172.21.15.100:0/1969113972 reap_dead start 2024-09-10T21:07:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.221+0000 7f335ac00640 1 -- 172.21.15.100:0/1969113972 shutdown_connections 2024-09-10T21:07:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.221+0000 7f335ac00640 1 -- 172.21.15.100:0/1969113972 >> 172.21.15.100:0/1969113972 conn(0x7f335406cb50 msgr2=0x7f335406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.221+0000 7f335ac00640 1 -- 172.21.15.100:0/1969113972 shutdown_connections 2024-09-10T21:07:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.221+0000 7f335ac00640 1 -- 172.21.15.100:0/1969113972 wait complete. 2024-09-10T21:07:05.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.223+0000 7f335ac00640 1 Processor -- start 2024-09-10T21:07:05.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.223+0000 7f335ac00640 1 -- start start 2024-09-10T21:07:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f335ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 0x7f335415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f335ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33541f7830 0x7f3354153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f335ac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33540b07d0 0x7f33541f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f335ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f335415f970 con 0x7f3338003c60 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f335ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f335415f7f0 con 0x7f33541f7830 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f335ac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f33540b2860 con 0x7f33540b07d0 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 0x7f335415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 0x7f335415a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58046/0 (socket says 172.21.15.100:58046) 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33541f7830 0x7f3354153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353e00640 1 -- 172.21.15.100:0/4166425575 learned_addr learned my addr 172.21.15.100:0/4166425575 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:05.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3358c00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33540b07d0 0x7f33541f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353400640 1 -- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33540b07d0 msgr2=0x7f33541f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353400640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33540b07d0 0x7f33541f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353400640 1 -- 172.21.15.100:0/4166425575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 msgr2=0x7f335415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353400640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 0x7f335415a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353400640 1 -- 172.21.15.100:0/4166425575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33541f7df0 con 0x7f33541f7830 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3353e00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 0x7f335415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.224+0000 7f3358c00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33540b07d0 0x7f33541f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.225+0000 7f3353400640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33541f7830 0x7f3354153570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3340011860 tx=0x7f3340011d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.225+0000 7f334be00640 1 -- 172.21.15.100:0/4166425575 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334000f9a0 con 0x7f33541f7830 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.225+0000 7f334be00640 1 -- 172.21.15.100:0/4166425575 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f334000fb40 con 0x7f33541f7830 2024-09-10T21:07:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.225+0000 7f334be00640 1 -- 172.21.15.100:0/4166425575 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33400035f0 con 0x7f33541f7830 2024-09-10T21:07:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.225+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33541f80d0 con 0x7f33541f7830 2024-09-10T21:07:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.225+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33541f4350 con 0x7f33541f7830 2024-09-10T21:07:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.226+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33541f4550 con 0x7f33541f7830 2024-09-10T21:07:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.227+0000 7f334be00640 1 -- 172.21.15.100:0/4166425575 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3340018070 con 0x7f33541f7830 2024-09-10T21:07:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.228+0000 7f334be00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3334077f70 0x7f333407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.228+0000 7f334be00640 1 -- 172.21.15.100:0/4166425575 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f334009a860 con 0x7f33541f7830 2024-09-10T21:07:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.229+0000 7f3353e00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3334077f70 0x7f333407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.229+0000 7f3353e00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3334077f70 0x7f333407a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33440015c0 tx=0x7f3344001360 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.234+0000 7f334be00640 1 -- 172.21.15.100:0/4166425575 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f33541f4550 con 0x7f33541f7830 2024-09-10T21:07:05.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.488+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f33540cc490 con 0x7f33541f7830 2024-09-10T21:07:05.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.496+0000 7f334be00640 1 -- 172.21.15.100:0/4166425575 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f3340062ec0 con 0x7f33541f7830 2024-09-10T21:07:05.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3334077f70 msgr2=0x7f333407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3334077f70 0x7f333407a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33440015c0 tx=0x7f3344001360 comp rx=0 tx=0).stop 2024-09-10T21:07:05.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33541f7830 msgr2=0x7f3354153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33541f7830 0x7f3354153570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3340011860 tx=0x7f3340011d20 comp rx=0 tx=0).stop 2024-09-10T21:07:05.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 shutdown_connections 2024-09-10T21:07:05.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33540b07d0 0x7f33541f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3334077f70 0x7f333407a430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33541f7830 0x7f3354153570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 --2- 172.21.15.100:0/4166425575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3338003c60 0x7f335415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 >> 172.21.15.100:0/4166425575 conn(0x7f335406cb50 msgr2=0x7f33540ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 shutdown_connections 2024-09-10T21:07:05.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.498+0000 7f335ac00640 1 -- 172.21.15.100:0/4166425575 wait complete. 2024-09-10T21:07:05.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T21:07:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.674+0000 7f89b2c00640 1 -- 172.21.15.100:0/2635789935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac0d0900 msgr2=0x7f89ac0b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.674+0000 7f89b2c00640 1 --2- 172.21.15.100:0/2635789935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac0d0900 0x7f89ac0b33a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f89a4005fd0 tx=0x7f89a402a8b0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.674+0000 7f89b2c00640 1 -- 172.21.15.100:0/2635789935 shutdown_connections 2024-09-10T21:07:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.674+0000 7f89b2c00640 1 --2- 172.21.15.100:0/2635789935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac0d0900 0x7f89ac0b33a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.674+0000 7f89b2c00640 1 -- 172.21.15.100:0/2635789935 >> 172.21.15.100:0/2635789935 conn(0x7f89ac0d3a40 msgr2=0x7f89ac0d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.674+0000 7f89b2c00640 1 -- 172.21.15.100:0/2635789935 shutdown_connections 2024-09-10T21:07:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.674+0000 7f89b2c00640 1 -- 172.21.15.100:0/2635789935 wait complete. 2024-09-10T21:07:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.675+0000 7f89b2c00640 1 Processor -- start 2024-09-10T21:07:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.676+0000 7f89b2c00640 1 -- start start 2024-09-10T21:07:05.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.676+0000 7f89b2c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89ac0d0900 0x7f89ac0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.676+0000 7f89b2c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac15db30 0x7f89ac0c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.676+0000 7f89b2c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89ac14fdc0 0x7f89ac150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.676+0000 7f89b2c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b38e0 con 0x7f89ac15db30 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.676+0000 7f89b2c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0d47b0 con 0x7f89ac0d0900 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.676+0000 7f89b2c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac0b3a60 con 0x7f89ac14fdc0 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac15db30 0x7f89ac0c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac15db30 0x7f89ac0c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58068/0 (socket says 172.21.15.100:58068) 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 -- 172.21.15.100:0/1064349119 learned_addr learned my addr 172.21.15.100:0/1064349119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b1800640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89ac0d0900 0x7f89ac0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b2200640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89ac14fdc0 0x7f89ac150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 -- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89ac14fdc0 msgr2=0x7f89ac150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89ac14fdc0 0x7f89ac150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 -- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89ac0d0900 msgr2=0x7f89ac0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89ac0d0900 0x7f89ac0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 -- 172.21.15.100:0/1064349119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac0ca850 con 0x7f89ac15db30 2024-09-10T21:07:05.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b2200640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89ac14fdc0 0x7f89ac150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:05.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.677+0000 7f89b0e00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac15db30 0x7f89ac0c8e80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f899800c410 tx=0x7f899800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.678+0000 7f89a9600640 1 -- 172.21.15.100:0/1064349119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998017070 con 0x7f89ac15db30 2024-09-10T21:07:05.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.678+0000 7f89a9600640 1 -- 172.21.15.100:0/1064349119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89980035f0 con 0x7f89ac15db30 2024-09-10T21:07:05.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.678+0000 7f89a9600640 1 -- 172.21.15.100:0/1064349119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998003a80 con 0x7f89ac15db30 2024-09-10T21:07:05.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.678+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac0c97b0 con 0x7f89ac15db30 2024-09-10T21:07:05.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.678+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac0c9d70 con 0x7f89ac15db30 2024-09-10T21:07:05.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.679+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac0b3f00 con 0x7f89ac15db30 2024-09-10T21:07:05.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.680+0000 7f89a9600640 1 -- 172.21.15.100:0/1064349119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8998003c20 con 0x7f89ac15db30 2024-09-10T21:07:05.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.681+0000 7f89a9600640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f898c077fa0 0x7f898c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.681+0000 7f89a9600640 1 -- 172.21.15.100:0/1064349119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f8998098d90 con 0x7f89ac15db30 2024-09-10T21:07:05.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.681+0000 7f89b1800640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f898c077fa0 0x7f898c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.682+0000 7f89b1800640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f898c077fa0 0x7f898c07a460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89a00046b0 tx=0x7f89a0007eb0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.685+0000 7f89a9600640 1 -- 172.21.15.100:0/1064349119 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f89980010c0 con 0x7f89ac15db30 2024-09-10T21:07:05.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.937+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f89ac0b99c0 con 0x7f89ac15db30 2024-09-10T21:07:05.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.942+0000 7f89a9600640 1 -- 172.21.15.100:0/1064349119 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f899806a0d0 con 0x7f89ac15db30 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f898c077fa0 msgr2=0x7f898c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f898c077fa0 0x7f898c07a460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89a00046b0 tx=0x7f89a0007eb0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac15db30 msgr2=0x7f89ac0c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac15db30 0x7f89ac0c8e80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f899800c410 tx=0x7f899800c8d0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 shutdown_connections 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89ac14fdc0 0x7f89ac150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89ac15db30 0x7f89ac0c8e80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f898c077fa0 0x7f898c07a460 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 --2- 172.21.15.100:0/1064349119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89ac0d0900 0x7f89ac0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 >> 172.21.15.100:0/1064349119 conn(0x7f89ac0d3a40 msgr2=0x7f89ac0b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 shutdown_connections 2024-09-10T21:07:05.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:05.944+0000 7f89b2c00640 1 -- 172.21.15.100:0/1064349119 wait complete. 2024-09-10T21:07:05.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T21:07:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.118+0000 7f347b200640 1 -- 172.21.15.100:0/1470000958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c004040 msgr2=0x7f345c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.118+0000 7f347b200640 1 --2- 172.21.15.100:0/1470000958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f345c004040 0x7f345c004800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3464009b20 tx=0x7f345c005830 comp rx=0 tx=0).stop 2024-09-10T21:07:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.118+0000 7f347a800640 1 -- 172.21.15.100:0/1470000958 reap_dead start 2024-09-10T21:07:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.118+0000 7f347b200640 1 -- 172.21.15.100:0/1470000958 shutdown_connections 2024-09-10T21:07:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.118+0000 7f347b200640 1 -- 172.21.15.100:0/1470000958 >> 172.21.15.100:0/1470000958 conn(0x7f347406d500 msgr2=0x7f34740b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.118+0000 7f347b200640 1 -- 172.21.15.100:0/1470000958 shutdown_connections 2024-09-10T21:07:06.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.118+0000 7f347b200640 1 -- 172.21.15.100:0/1470000958 wait complete. 2024-09-10T21:07:06.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.120+0000 7f347b200640 1 Processor -- start 2024-09-10T21:07:06.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.120+0000 7f347b200640 1 -- start start 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f345c004040 0x7f34740b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347b200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34740b26f0 0x7f34741f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34741f5ec0 0x7f3474142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3474073610 con 0x7f34741f5ec0 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347b200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34740af020 con 0x7f345c004040 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347b200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3474073790 con 0x7f34740b26f0 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34741f5ec0 0x7f3474142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34741f5ec0 0x7f3474142100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58082/0 (socket says 172.21.15.100:58082) 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347a800640 1 -- 172.21.15.100:0/2067952828 learned_addr learned my addr 172.21.15.100:0/2067952828 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f3479e00640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f345c004040 0x7f34740b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f3479400640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34740b26f0 0x7f34741f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347a800640 1 -- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34740b26f0 msgr2=0x7f34741f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347a800640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34740b26f0 0x7f34741f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347a800640 1 -- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f345c004040 msgr2=0x7f34740b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347a800640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f345c004040 0x7f34740b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.121+0000 7f347a800640 1 -- 172.21.15.100:0/2067952828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34740b2bb0 con 0x7f34741f5ec0 2024-09-10T21:07:06.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.122+0000 7f347a800640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34741f5ec0 0x7f3474142100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3470000f80 tx=0x7f347000ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:06.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.122+0000 7f346e000640 1 -- 172.21.15.100:0/2067952828 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468009720 con 0x7f34741f5ec0 2024-09-10T21:07:06.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.122+0000 7f346e000640 1 -- 172.21.15.100:0/2067952828 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3470018070 con 0x7f34741f5ec0 2024-09-10T21:07:06.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.122+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34740b2e90 con 0x7f34741f5ec0 2024-09-10T21:07:06.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.122+0000 7f346e000640 1 -- 172.21.15.100:0/2067952828 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347000cca0 con 0x7f34741f5ec0 2024-09-10T21:07:06.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.122+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34740b3450 con 0x7f34741f5ec0 2024-09-10T21:07:06.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.123+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347415bcd0 con 0x7f34741f5ec0 2024-09-10T21:07:06.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.124+0000 7f346e000640 1 -- 172.21.15.100:0/2067952828 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f347001d460 con 0x7f34741f5ec0 2024-09-10T21:07:06.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.125+0000 7f346e000640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3458077f70 0x7f345807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:06.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.125+0000 7f346e000640 1 -- 172.21.15.100:0/2067952828 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f3470099dd0 con 0x7f34741f5ec0 2024-09-10T21:07:06.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.126+0000 7f3479e00640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3458077f70 0x7f345807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.126+0000 7f3479e00640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3458077f70 0x7f345807a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3468009d10 tx=0x7f3468005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:06.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.129+0000 7f346e000640 1 -- 172.21.15.100:0/2067952828 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f34700629f0 con 0x7f34741f5ec0 2024-09-10T21:07:06.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.314+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f347415cac0 con 0x7f34741f5ec0 2024-09-10T21:07:06.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.314+0000 7f346e000640 1 -- 172.21.15.100:0/2067952828 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7f347006b110 con 0x7f34741f5ec0 2024-09-10T21:07:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:06.319 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-09-10T21:07:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-10T21:07:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-09-10T21:07:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-09-10T21:07:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:06.320 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-09-10T21:07:06.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3458077f70 msgr2=0x7f345807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3458077f70 0x7f345807a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3468009d10 tx=0x7f3468005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:06.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34741f5ec0 msgr2=0x7f3474142100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34741f5ec0 0x7f3474142100 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3470000f80 tx=0x7f347000ea60 comp rx=0 tx=0).stop 2024-09-10T21:07:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 shutdown_connections 2024-09-10T21:07:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34741f5ec0 0x7f3474142100 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34740b26f0 0x7f34741f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3458077f70 0x7f345807a430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 --2- 172.21.15.100:0/2067952828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f345c004040 0x7f34740b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.316+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 >> 172.21.15.100:0/2067952828 conn(0x7f347406d500 msgr2=0x7f34740cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.317+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 shutdown_connections 2024-09-10T21:07:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.317+0000 7f347b200640 1 -- 172.21.15.100:0/2067952828 wait complete. 2024-09-10T21:07:06.336 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T21:07:06.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T21:07:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.492+0000 7fa5d7200640 1 -- 172.21.15.100:0/1958215048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d80b5c20 msgr2=0x7fa5d80cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.492+0000 7fa5d7200640 1 --2- 172.21.15.100:0/1958215048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d80b5c20 0x7fa5d80cea30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa5d808dc10 tx=0x7fa5d002aac0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.493+0000 7fa5d7200640 1 -- 172.21.15.100:0/1958215048 shutdown_connections 2024-09-10T21:07:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.493+0000 7fa5d7200640 1 --2- 172.21.15.100:0/1958215048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d80b5c20 0x7fa5d80cea30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.493+0000 7fa5d7200640 1 --2- 172.21.15.100:0/1958215048 >> v2:172.21.15.130:3300/0 conn(0x7fa5d815d8a0 0x7fa5d80b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.493+0000 7fa5d7200640 1 -- 172.21.15.100:0/1958215048 >> 172.21.15.100:0/1958215048 conn(0x7fa5d808d460 msgr2=0x7fa5d809cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.493+0000 7fa5d7200640 1 -- 172.21.15.100:0/1958215048 shutdown_connections 2024-09-10T21:07:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.493+0000 7fa5d7200640 1 -- 172.21.15.100:0/1958215048 wait complete. 2024-09-10T21:07:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.494+0000 7fa5d7200640 1 Processor -- start 2024-09-10T21:07:06.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.494+0000 7fa5d7200640 1 -- start start 2024-09-10T21:07:06.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.495+0000 7fa5d7200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5d80b5c20 0x7fa5d81f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:06.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.495+0000 7fa5d7200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5d80ce5a0 0x7fa5d80cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.495+0000 7fa5d7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d815d8a0 0x7fa5d8157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.495+0000 7fa5d7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d80d0510 con 0x7fa5d815d8a0 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.495+0000 7fa5d7200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d80d0390 con 0x7fa5d80b5c20 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.495+0000 7fa5d7200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d80d0690 con 0x7fa5d80ce5a0 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d815d8a0 0x7fa5d8157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d815d8a0 0x7fa5d8157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58100/0 (socket says 172.21.15.100:58100) 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 -- 172.21.15.100:0/4256237866 learned_addr learned my addr 172.21.15.100:0/4256237866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d5e00640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5d80b5c20 0x7fa5d81f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d5400640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5d80ce5a0 0x7fa5d80cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:06.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 -- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5d80ce5a0 msgr2=0x7fa5d80cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5d80ce5a0 0x7fa5d80cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 -- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5d80b5c20 msgr2=0x7fa5d81f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5d80b5c20 0x7fa5d81f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 -- 172.21.15.100:0/4256237866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d81f8860 con 0x7fa5d815d8a0 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d5e00640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5d80b5c20 0x7fa5d81f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.496+0000 7fa5d6800640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d815d8a0 0x7fa5d8157910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009d60 tx=0x7fa5d0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.497+0000 7fa5ce000640 1 -- 172.21.15.100:0/4256237866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0044070 con 0x7fa5d815d8a0 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.497+0000 7fa5ce000640 1 -- 172.21.15.100:0/4256237866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5d0004250 con 0x7fa5d815d8a0 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.497+0000 7fa5ce000640 1 -- 172.21.15.100:0/4256237866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0004680 con 0x7fa5d815d8a0 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.497+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d81f8b40 con 0x7fa5d815d8a0 2024-09-10T21:07:06.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.497+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d80ccde0 con 0x7fa5d815d8a0 2024-09-10T21:07:06.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.498+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5d80ca2f0 con 0x7fa5d815d8a0 2024-09-10T21:07:06.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.499+0000 7fa5ce000640 1 -- 172.21.15.100:0/4256237866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa5d002c840 con 0x7fa5d815d8a0 2024-09-10T21:07:06.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.500+0000 7fa5ce000640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa5b8077f70 0x7fa5b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:06.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.500+0000 7fa5ce000640 1 -- 172.21.15.100:0/4256237866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fa5d00ba1d0 con 0x7fa5d815d8a0 2024-09-10T21:07:06.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.501+0000 7fa5d5e00640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa5b8077f70 0x7fa5b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:06.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.501+0000 7fa5d5e00640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa5b8077f70 0x7fa5b807a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8159b30 tx=0x7fa5c8005f10 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.504+0000 7fa5ce000640 1 -- 172.21.15.100:0/4256237866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa5d0032030 con 0x7fa5d815d8a0 2024-09-10T21:07:06.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.689+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa5d80b35c0 con 0x7fa5d815d8a0 2024-09-10T21:07:06.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.950+0000 7fa5ce000640 1 -- 172.21.15.100:0/4256237866 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7fa5d0004820 con 0x7fa5d815d8a0 2024-09-10T21:07:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-09-10T21:07:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.952+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa5b8077f70 msgr2=0x7fa5b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.952+0000 7fa5d7200640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa5b8077f70 0x7fa5b807a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8159b30 tx=0x7fa5c8005f10 comp rx=0 tx=0).stop 2024-09-10T21:07:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.952+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d815d8a0 msgr2=0x7fa5d8157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.952+0000 7fa5d7200640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d815d8a0 0x7fa5d8157910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009d60 tx=0x7fa5d0003f10 comp rx=0 tx=0).stop 2024-09-10T21:07:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.953+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 shutdown_connections 2024-09-10T21:07:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.953+0000 7fa5d7200640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5d815d8a0 0x7fa5d8157910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.953+0000 7fa5d7200640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5d80ce5a0 0x7fa5d80cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.953+0000 7fa5d7200640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa5b8077f70 0x7fa5b807a430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.953+0000 7fa5d7200640 1 --2- 172.21.15.100:0/4256237866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5d80b5c20 0x7fa5d81f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.953+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 >> 172.21.15.100:0/4256237866 conn(0x7fa5d808d460 msgr2=0x7fa5d80b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.953+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 shutdown_connections 2024-09-10T21:07:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:06.953+0000 7fa5d7200640 1 -- 172.21.15.100:0/4256237866 wait complete. 2024-09-10T21:07:06.977 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T21:07:07.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.136+0000 7f0965800640 1 -- 172.21.15.100:0/161063930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096015ab00 msgr2=0x7f09600aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.136+0000 7f0965800640 1 --2- 172.21.15.100:0/161063930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096015ab00 0x7f09600aec00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0950005fd0 tx=0x7f095002a530 comp rx=0 tx=0).stop 2024-09-10T21:07:07.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.137+0000 7f0965800640 1 -- 172.21.15.100:0/161063930 shutdown_connections 2024-09-10T21:07:07.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.137+0000 7f0965800640 1 --2- 172.21.15.100:0/161063930 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0960072ad0 0x7f09600cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.137+0000 7f0965800640 1 --2- 172.21.15.100:0/161063930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096015ab00 0x7f09600aec00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.137+0000 7f0965800640 1 -- 172.21.15.100:0/161063930 >> 172.21.15.100:0/161063930 conn(0x7f09600cf7e0 msgr2=0x7f09600cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:07.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.137+0000 7f0965800640 1 -- 172.21.15.100:0/161063930 shutdown_connections 2024-09-10T21:07:07.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.137+0000 7f0965800640 1 -- 172.21.15.100:0/161063930 wait complete. 2024-09-10T21:07:07.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.138+0000 7f0965800640 1 Processor -- start 2024-09-10T21:07:07.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.138+0000 7f0965800640 1 -- start start 2024-09-10T21:07:07.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.139+0000 7f0965800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960072ad0 0x7f0960144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.139+0000 7f0965800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600b4210 0x7f0960144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.139+0000 7f0965800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f096015ab00 0x7f09601478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.139+0000 7f0965800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09600ccdb0 con 0x7f0960072ad0 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.139+0000 7f0965800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09600ccc30 con 0x7f096015ab00 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.139+0000 7f0965800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f09600ccf30 con 0x7f09600b4210 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960072ad0 0x7f0960144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960072ad0 0x7f0960144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58120/0 (socket says 172.21.15.100:58120) 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 -- 172.21.15.100:0/403762028 learned_addr learned my addr 172.21.15.100:0/403762028 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095f400640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f096015ab00 0x7f09601478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f0956000640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600b4210 0x7f0960144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 -- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600b4210 msgr2=0x7f0960144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600b4210 0x7f0960144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 -- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f096015ab00 msgr2=0x7f09601478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f096015ab00 0x7f09601478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 -- 172.21.15.100:0/403762028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0960154250 con 0x7f0960072ad0 2024-09-10T21:07:07.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095f400640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f096015ab00 0x7f09601478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:07.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.140+0000 7f095ea00640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960072ad0 0x7f0960144970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0950000c00 tx=0x7f0950003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:07.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.141+0000 7f0957400640 1 -- 172.21.15.100:0/403762028 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095003e030 con 0x7f0960072ad0 2024-09-10T21:07:07.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.141+0000 7f0957400640 1 -- 172.21.15.100:0/403762028 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0950003e00 con 0x7f0960072ad0 2024-09-10T21:07:07.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.141+0000 7f0957400640 1 -- 172.21.15.100:0/403762028 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950035040 con 0x7f0960072ad0 2024-09-10T21:07:07.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.141+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0960154530 con 0x7f0960072ad0 2024-09-10T21:07:07.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.141+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0960156c00 con 0x7f0960072ad0 2024-09-10T21:07:07.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.142+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09600cbd00 con 0x7f0960072ad0 2024-09-10T21:07:07.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.143+0000 7f0957400640 1 -- 172.21.15.100:0/403762028 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0950004a00 con 0x7f0960072ad0 2024-09-10T21:07:07.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.144+0000 7f0957400640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f093c077f70 0x7f093c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.144+0000 7f0957400640 1 -- 172.21.15.100:0/403762028 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5619+0+0 (secure 0 0 0) 0x7f09500ba6e0 con 0x7f0960072ad0 2024-09-10T21:07:07.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.144+0000 7f0956000640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f093c077f70 0x7f093c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.145+0000 7f0956000640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f093c077f70 0x7f093c07a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0960150710 tx=0x7f0948009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:07.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.149+0000 7f0957400640 1 -- 172.21.15.100:0/403762028 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0950083190 con 0x7f0960072ad0 2024-09-10T21:07:07.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.335+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f09600cc300 con 0x7f0960072ad0 2024-09-10T21:07:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.953+0000 7f0957400640 1 -- 172.21.15.100:0/403762028 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7f0950082a90 con 0x7f0960072ad0 2024-09-10T21:07:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-09-10T21:07:07.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.955+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f093c077f70 msgr2=0x7f093c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.955+0000 7f0965800640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f093c077f70 0x7f093c07a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0960150710 tx=0x7f0948009040 comp rx=0 tx=0).stop 2024-09-10T21:07:07.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.955+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960072ad0 msgr2=0x7f0960144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.955+0000 7f0965800640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960072ad0 0x7f0960144970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0950000c00 tx=0x7f0950003910 comp rx=0 tx=0).stop 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.956+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 shutdown_connections 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.956+0000 7f0965800640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f093c077f70 0x7f093c07a430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.956+0000 7f0965800640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f096015ab00 0x7f09601478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.956+0000 7f0965800640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600b4210 0x7f0960144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.956+0000 7f0965800640 1 --2- 172.21.15.100:0/403762028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960072ad0 0x7f0960144970 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.956+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 >> 172.21.15.100:0/403762028 conn(0x7f09600cf7e0 msgr2=0x7f09600ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.956+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 shutdown_connections 2024-09-10T21:07:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:07.956+0000 7f0965800640 1 -- 172.21.15.100:0/403762028 wait complete. 2024-09-10T21:07:07.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T21:07:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.146+0000 7f18e7000640 1 -- 172.21.15.100:0/772875544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c4003a80 msgr2=0x7f18c4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.146+0000 7f18e7000640 1 --2- 172.21.15.100:0/772875544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c4003a80 0x7f18c4003ea0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c560 tx=0x7f18c4005830 comp rx=0 tx=0).stop 2024-09-10T21:07:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.146+0000 7f18e5000640 1 -- 172.21.15.100:0/772875544 reap_dead start 2024-09-10T21:07:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.146+0000 7f18e7000640 1 -- 172.21.15.100:0/772875544 shutdown_connections 2024-09-10T21:07:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.146+0000 7f18e7000640 1 -- 172.21.15.100:0/772875544 >> 172.21.15.100:0/772875544 conn(0x7f18e006cb50 msgr2=0x7f18e006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.146+0000 7f18e7000640 1 -- 172.21.15.100:0/772875544 shutdown_connections 2024-09-10T21:07:08.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.146+0000 7f18e7000640 1 -- 172.21.15.100:0/772875544 wait complete. 2024-09-10T21:07:08.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.148+0000 7f18e7000640 1 Processor -- start 2024-09-10T21:07:08.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.148+0000 7f18e7000640 1 -- start start 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e7000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c4003a80 0x7f18e00b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e7000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18e01f3980 0x7f18e01f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e01f4320 0x7f18e01f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18e015a990 con 0x7f18e01f4320 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e7000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f18e015a810 con 0x7f18c4003a80 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e7000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f18e015ab10 con 0x7f18e01f3980 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e01f4320 0x7f18e01f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e01f4320 0x7f18e01f7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58128/0 (socket says 172.21.15.100:58128) 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e5000640 1 -- 172.21.15.100:0/4143722032 learned_addr learned my addr 172.21.15.100:0/4143722032 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18dfe00640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c4003a80 0x7f18e00b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18df400640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18e01f3980 0x7f18e01f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e5000640 1 -- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18e01f3980 msgr2=0x7f18e01f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e5000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18e01f3980 0x7f18e01f3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e5000640 1 -- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c4003a80 msgr2=0x7f18e00b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e5000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c4003a80 0x7f18e00b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18e5000640 1 -- 172.21.15.100:0/4143722032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e00b1ce0 con 0x7f18e01f4320 2024-09-10T21:07:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.149+0000 7f18df400640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18e01f3980 0x7f18e01f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.150+0000 7f18e5000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e01f4320 0x7f18e01f7ec0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f18e015d580 tx=0x7f18d8011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.150+0000 7f18d7e00640 1 -- 172.21.15.100:0/4143722032 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d800f8f0 con 0x7f18e01f4320 2024-09-10T21:07:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.150+0000 7f18d7e00640 1 -- 172.21.15.100:0/4143722032 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18d800fa90 con 0x7f18e01f4320 2024-09-10T21:07:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.150+0000 7f18d7e00640 1 -- 172.21.15.100:0/4143722032 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8005020 con 0x7f18e01f4320 2024-09-10T21:07:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.150+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e00afb90 con 0x7f18e01f4320 2024-09-10T21:07:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.150+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e00b1f80 con 0x7f18e01f4320 2024-09-10T21:07:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.151+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e0153f10 con 0x7f18e01f4320 2024-09-10T21:07:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.152+0000 7f18d7e00640 1 -- 172.21.15.100:0/4143722032 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f18d8018030 con 0x7f18e01f4320 2024-09-10T21:07:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.153+0000 7f18d7e00640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f18c0077f70 0x7f18c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.153+0000 7f18d7e00640 1 -- 172.21.15.100:0/4143722032 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6001+0+0 (secure 0 0 0) 0x7f18d809a620 con 0x7f18e01f4320 2024-09-10T21:07:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.154+0000 7f18dfe00640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f18c0077f70 0x7f18c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.155+0000 7f18dfe00640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f18c0077f70 0x7f18c007a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f18d0033000 tx=0x7f18d002d040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:08.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.157+0000 7f18d7e00640 1 -- 172.21.15.100:0/4143722032 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f18d8011e20 con 0x7f18e01f4320 2024-09-10T21:07:08.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.378+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f18e015cc40 con 0x7f18e01f4320 2024-09-10T21:07:08.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.971+0000 7f18d7e00640 1 -- 172.21.15.100:0/4143722032 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f18d8063160 con 0x7f18e01f4320 2024-09-10T21:07:08.982 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 5 and data pool 6 2024-09-10T21:07:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.981+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f18c0077f70 msgr2=0x7f18c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.981+0000 7f18e7000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f18c0077f70 0x7f18c007a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f18d0033000 tx=0x7f18d002d040 comp rx=0 tx=0).stop 2024-09-10T21:07:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.981+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e01f4320 msgr2=0x7f18e01f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.981+0000 7f18e7000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e01f4320 0x7f18e01f7ec0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f18e015d580 tx=0x7f18d8011bd0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.982+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 shutdown_connections 2024-09-10T21:07:08.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.982+0000 7f18e7000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e01f4320 0x7f18e01f7ec0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.982+0000 7f18e7000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18e01f3980 0x7f18e01f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.982+0000 7f18e7000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f18c0077f70 0x7f18c007a430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.982+0000 7f18e7000640 1 --2- 172.21.15.100:0/4143722032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c4003a80 0x7f18e00b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.982+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 >> 172.21.15.100:0/4143722032 conn(0x7f18e006cb50 msgr2=0x7f18e015b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.983+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 shutdown_connections 2024-09-10T21:07:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:08.983+0000 7f18e7000640 1 -- 172.21.15.100:0/4143722032 wait complete. 2024-09-10T21:07:09.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:07:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.174+0000 7fd91b000640 1 -- 172.21.15.100:0/2536478816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1370 msgr2=0x7fd9140b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.174+0000 7fd91b000640 1 --2- 172.21.15.100:0/2536478816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1370 0x7fd9140b17c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd9140c54e0 tx=0x7fd90002a560 comp rx=0 tx=0).stop 2024-09-10T21:07:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.174+0000 7fd91b000640 1 -- 172.21.15.100:0/2536478816 shutdown_connections 2024-09-10T21:07:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.174+0000 7fd91b000640 1 --2- 172.21.15.100:0/2536478816 >> v2:172.21.15.130:3300/0 conn(0x7fd9140b1d00 0x7fd9140af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.174+0000 7fd91b000640 1 --2- 172.21.15.100:0/2536478816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1370 0x7fd9140b17c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.174+0000 7fd91b000640 1 -- 172.21.15.100:0/2536478816 >> 172.21.15.100:0/2536478816 conn(0x7fd9140d1a10 msgr2=0x7fd9140d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:09.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.174+0000 7fd91b000640 1 -- 172.21.15.100:0/2536478816 shutdown_connections 2024-09-10T21:07:09.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.174+0000 7fd91b000640 1 -- 172.21.15.100:0/2536478816 wait complete. 2024-09-10T21:07:09.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.176+0000 7fd91b000640 1 Processor -- start 2024-09-10T21:07:09.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.176+0000 7fd91b000640 1 -- start start 2024-09-10T21:07:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd91b000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9140b1370 0x7fd914158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd91b000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1d00 0x7fd9140b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd91b000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9140cfbf0 0x7fd9141583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd91b000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd9140b2ac0 con 0x7fd9140b1d00 2024-09-10T21:07:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd91b000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9140b2940 con 0x7fd9140b1370 2024-09-10T21:07:09.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd91b000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd9140afaa0 con 0x7fd9140cfbf0 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1d00 0x7fd9140b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1d00 0x7fd9140b5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58156/0 (socket says 172.21.15.100:58156) 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913400640 1 -- 172.21.15.100:0/1011302599 learned_addr learned my addr 172.21.15.100:0/1011302599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913e00640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9140b1370 0x7fd914158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd919000640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9140cfbf0 0x7fd9141583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913400640 1 -- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9140cfbf0 msgr2=0x7fd9141583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913400640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9140cfbf0 0x7fd9141583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913400640 1 -- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9140b1370 msgr2=0x7fd914158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913400640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9140b1370 0x7fd914158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.177+0000 7fd913400640 1 -- 172.21.15.100:0/1011302599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9141f7ac0 con 0x7fd9140b1d00 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.178+0000 7fd913400640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1d00 0x7fd9140b5b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd900000c00 tx=0x7fd900003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.178+0000 7fd90be00640 1 -- 172.21.15.100:0/1011302599 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90003f070 con 0x7fd9140b1d00 2024-09-10T21:07:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.178+0000 7fd90be00640 1 -- 172.21.15.100:0/1011302599 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9000047a0 con 0x7fd9140b1d00 2024-09-10T21:07:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.178+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9141f7da0 con 0x7fd9140b1d00 2024-09-10T21:07:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.178+0000 7fd90be00640 1 -- 172.21.15.100:0/1011302599 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900035030 con 0x7fd9140b1d00 2024-09-10T21:07:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.178+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9141f8360 con 0x7fd9140b1d00 2024-09-10T21:07:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.179+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9140b17c0 con 0x7fd9140b1d00 2024-09-10T21:07:09.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.180+0000 7fd90be00640 1 -- 172.21.15.100:0/1011302599 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd900004bb0 con 0x7fd9140b1d00 2024-09-10T21:07:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.182+0000 7fd90be00640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd8f4077f70 0x7fd8f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.182+0000 7fd90be00640 1 -- 172.21.15.100:0/1011302599 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd9000bafd0 con 0x7fd9140b1d00 2024-09-10T21:07:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.182+0000 7fd913e00640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd8f4077f70 0x7fd8f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.183+0000 7fd913e00640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd8f4077f70 0x7fd8f407a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd904000f60 tx=0x7fd904009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.186+0000 7fd90be00640 1 -- 172.21.15.100:0/1011302599 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd9000832f0 con 0x7fd9140b1d00 2024-09-10T21:07:09.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.372+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd91406dd00 con 0x7fd9140b1d00 2024-09-10T21:07:09.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.373+0000 7fd90be00640 1 -- 172.21.15.100:0/1011302599 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17039 (secure 0 0 0) 0x7fd90008c060 con 0x7fd9140b1d00 2024-09-10T21:07:09.378 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:09.378 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":40,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:07:08.380709+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:07:06.699580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T21:07:07.345691+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd8f4077f70 msgr2=0x7fd8f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd8f4077f70 0x7fd8f407a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd904000f60 tx=0x7fd904009040 comp rx=0 tx=0).stop 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1d00 msgr2=0x7fd9140b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1d00 0x7fd9140b5b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd900000c00 tx=0x7fd900003910 comp rx=0 tx=0).stop 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 shutdown_connections 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9140cfbf0 0x7fd9141583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9140b1d00 0x7fd9140b5b10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd8f4077f70 0x7fd8f407a430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 --2- 172.21.15.100:0/1011302599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9140b1370 0x7fd914158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 >> 172.21.15.100:0/1011302599 conn(0x7fd9140d1a10 msgr2=0x7fd9140d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:09.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 shutdown_connections 2024-09-10T21:07:09.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.376+0000 7fd91b000640 1 -- 172.21.15.100:0/1011302599 wait complete. 2024-09-10T21:07:09.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:07:09.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.549+0000 7f9666c00640 1 -- 172.21.15.100:0/3098173632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600aea30 msgr2=0x7f9660073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.549+0000 7f9666c00640 1 --2- 172.21.15.100:0/3098173632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600aea30 0x7f9660073610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9660152dc0 tx=0x7f965402a560 comp rx=0 tx=0).stop 2024-09-10T21:07:09.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.549+0000 7f9666c00640 1 -- 172.21.15.100:0/3098173632 shutdown_connections 2024-09-10T21:07:09.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.549+0000 7f9666c00640 1 --2- 172.21.15.100:0/3098173632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f966015c210 0x7f966015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.549+0000 7f9666c00640 1 --2- 172.21.15.100:0/3098173632 >> v2:172.21.15.130:3300/0 conn(0x7f96600cec80 0x7f966015bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.549+0000 7f9666c00640 1 --2- 172.21.15.100:0/3098173632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600aea30 0x7f9660073610 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.549+0000 7f9666c00640 1 -- 172.21.15.100:0/3098173632 >> 172.21.15.100:0/3098173632 conn(0x7f966006d500 msgr2=0x7f96600b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:09.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.550+0000 7f9666c00640 1 -- 172.21.15.100:0/3098173632 shutdown_connections 2024-09-10T21:07:09.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.550+0000 7f9666c00640 1 -- 172.21.15.100:0/3098173632 wait complete. 2024-09-10T21:07:09.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.551+0000 7f9666c00640 1 Processor -- start 2024-09-10T21:07:09.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.551+0000 7f9666c00640 1 -- start start 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9666c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f96600aea30 0x7f9660151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9666c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600cec80 0x7f9660154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9666c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f966015c210 0x7f96601551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9666c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f966015ffb0 con 0x7f96600cec80 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9666c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f966015fe30 con 0x7f966015c210 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9666c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9660160130 con 0x7f96600aea30 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9664e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600cec80 0x7f9660154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9664e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600cec80 0x7f9660154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58180/0 (socket says 172.21.15.100:58180) 2024-09-10T21:07:09.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9664e00640 1 -- 172.21.15.100:0/4058495793 learned_addr learned my addr 172.21.15.100:0/4058495793 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9665800640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f96600aea30 0x7f9660151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.552+0000 7f9666200640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f966015c210 0x7f96601551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f9664e00640 1 -- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f96600aea30 msgr2=0x7f9660151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f9664e00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f96600aea30 0x7f9660151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f9664e00640 1 -- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f966015c210 msgr2=0x7f96601551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f9664e00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f966015c210 0x7f96601551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f9664e00640 1 -- 172.21.15.100:0/4058495793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96600cb910 con 0x7f96600cec80 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f9664e00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600cec80 0x7f9660154c90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f964c00d7a0 tx=0x7f964c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f965d600640 1 -- 172.21.15.100:0/4058495793 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c017070 con 0x7f96600cec80 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f965d600640 1 -- 172.21.15.100:0/4058495793 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f964c009d20 con 0x7f96600cec80 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96601f42b0 con 0x7f96600cec80 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.553+0000 7f965d600640 1 -- 172.21.15.100:0/4058495793 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c0106c0 con 0x7f96600cec80 2024-09-10T21:07:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.554+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9660155800 con 0x7f96600cec80 2024-09-10T21:07:09.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.554+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96600b20f0 con 0x7f96600cec80 2024-09-10T21:07:09.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.556+0000 7f965d600640 1 -- 172.21.15.100:0/4058495793 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f964c010860 con 0x7f96600cec80 2024-09-10T21:07:09.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.556+0000 7f965d600640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9640077f70 0x7f964007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.557+0000 7f965d600640 1 -- 172.21.15.100:0/4058495793 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f964c09a290 con 0x7f96600cec80 2024-09-10T21:07:09.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.557+0000 7f9665800640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9640077f70 0x7f964007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.558+0000 7f9665800640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9640077f70 0x7f964007a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9654033000 tx=0x7f9654004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.561+0000 7f965d600640 1 -- 172.21.15.100:0/4058495793 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f96600b20f0 con 0x7f96600cec80 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.743+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f966015bcd0 con 0x7f96600cec80 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.744+0000 7f965d600640 1 -- 172.21.15.100:0/4058495793 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17039 (secure 0 0 0) 0x7f964c062640 con 0x7f96600cec80 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":40,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:07:08.380709+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:07:06.699580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T21:07:07.345691+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.746+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9640077f70 msgr2=0x7f964007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.746+0000 7f9666c00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9640077f70 0x7f964007a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9654033000 tx=0x7f9654004730 comp rx=0 tx=0).stop 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.746+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600cec80 msgr2=0x7f9660154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.746+0000 7f9666c00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600cec80 0x7f9660154c90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f964c00d7a0 tx=0x7f964c00dc60 comp rx=0 tx=0).stop 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.747+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 shutdown_connections 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.747+0000 7f9666c00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9640077f70 0x7f964007a430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.747+0000 7f9666c00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f966015c210 0x7f96601551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.747+0000 7f9666c00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96600cec80 0x7f9660154c90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.747+0000 7f9666c00640 1 --2- 172.21.15.100:0/4058495793 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f96600aea30 0x7f9660151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.747+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 >> 172.21.15.100:0/4058495793 conn(0x7f966006d500 msgr2=0x7f966015d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.747+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 shutdown_connections 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.747+0000 7f9666c00640 1 -- 172.21.15.100:0/4058495793 wait complete. 2024-09-10T21:07:09.767 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.924+0000 7fbed2200640 1 -- 172.21.15.100:0/2141313428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc0741e0 msgr2=0x7fbecc15f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.924+0000 7fbed2200640 1 --2- 172.21.15.100:0/2141313428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc0741e0 0x7fbecc15f4d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009830 tx=0x7fbeb802a5b0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.924+0000 7fbed2200640 1 -- 172.21.15.100:0/2141313428 shutdown_connections 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.924+0000 7fbed2200640 1 --2- 172.21.15.100:0/2141313428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc0741e0 0x7fbecc15f4d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.924+0000 7fbed2200640 1 -- 172.21.15.100:0/2141313428 >> 172.21.15.100:0/2141313428 conn(0x7fbecc06cb50 msgr2=0x7fbecc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.925+0000 7fbed2200640 1 -- 172.21.15.100:0/2141313428 shutdown_connections 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.925+0000 7fbed2200640 1 -- 172.21.15.100:0/2141313428 wait complete. 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.926+0000 7fbed2200640 1 Processor -- start 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.926+0000 7fbed2200640 1 -- start start 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbed2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbecc0741e0 0x7fbecc1f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbed2200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc15b680 0x7fbecc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbed2200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbecc15c750 0x7fbecc15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbed2200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc0b2bf0 con 0x7fbecc0741e0 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbed2200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc0b2a70 con 0x7fbecc15b680 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbed2200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbecc0b2d70 con 0x7fbecc15c750 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbecb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbecc0741e0 0x7fbecc1f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbecb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbecc0741e0 0x7fbecc1f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58182/0 (socket says 172.21.15.100:58182) 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.927+0000 7fbecb400640 1 -- 172.21.15.100:0/372116917 learned_addr learned my addr 172.21.15.100:0/372116917 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbecaa00640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc15b680 0x7fbecc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbecbe00640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbecc15c750 0x7fbecc15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbecb400640 1 -- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbecc15c750 msgr2=0x7fbecc15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbecb400640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbecc15c750 0x7fbecc15e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbecb400640 1 -- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc15b680 msgr2=0x7fbecc15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbecb400640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc15b680 0x7fbecc15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbecb400640 1 -- 172.21.15.100:0/372116917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc1e5f10 con 0x7fbecc0741e0 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbecb400640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbecc0741e0 0x7fbecc1f4110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00c500 tx=0x7fbebc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbec3400640 1 -- 172.21.15.100:0/372116917 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0052d0 con 0x7fbecc0741e0 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbec3400640 1 -- 172.21.15.100:0/372116917 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbebc005470 con 0x7fbecc0741e0 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.928+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbecc1e61f0 con 0x7fbecc0741e0 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.929+0000 7fbec3400640 1 -- 172.21.15.100:0/372116917 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc012870 con 0x7fbecc0741e0 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.929+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbecc0af7b0 con 0x7fbecc0741e0 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.930+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbecc15f4d0 con 0x7fbecc0741e0 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.931+0000 7fbec3400640 1 -- 172.21.15.100:0/372116917 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbebc0035f0 con 0x7fbecc0741e0 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.932+0000 7fbec3400640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbeac077f70 0x7fbeac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.932+0000 7fbec3400640 1 -- 172.21.15.100:0/372116917 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fbebc0999e0 con 0x7fbecc0741e0 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.933+0000 7fbecaa00640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbeac077f70 0x7fbeac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.933+0000 7fbecaa00640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbeac077f70 0x7fbeac07a430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8034000 tx=0x7fbeb8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:09.936+0000 7fbec3400640 1 -- 172.21.15.100:0/372116917 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbebc061c70 con 0x7fbecc0741e0 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.159+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbecc0cc490 con 0x7fbecc0741e0 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.985+0000 7fbec3400640 1 -- 172.21.15.100:0/372116917 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fbebc0666a0 con 0x7fbecc0741e0 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.988+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbeac077f70 msgr2=0x7fbeac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.988+0000 7fbed2200640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbeac077f70 0x7fbeac07a430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8034000 tx=0x7fbeb8004730 comp rx=0 tx=0).stop 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbecc0741e0 msgr2=0x7fbecc1f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbecc0741e0 0x7fbecc1f4110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00c500 tx=0x7fbebc00c9c0 comp rx=0 tx=0).stop 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 shutdown_connections 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbecc15c750 0x7fbecc15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbeac077f70 0x7fbeac07a430 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc15b680 0x7fbecc15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 --2- 172.21.15.100:0/372116917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbecc0741e0 0x7fbecc1f4110 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 >> 172.21.15.100:0/372116917 conn(0x7fbecc06cb50 msgr2=0x7fbecc0ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 shutdown_connections 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:10.989+0000 7fbed2200640 1 -- 172.21.15.100:0/372116917 wait complete. 2024-09-10T21:07:11.011 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T21:07:11.011 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.170+0000 7fc2cac00640 1 -- 172.21.15.100:0/598771616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2c4155df0 msgr2=0x7fc2c40730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.170+0000 7fc2cac00640 1 --2- 172.21.15.100:0/598771616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2c4155df0 0x7fc2c40730d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8005fd0 tx=0x7fc2b802a540 comp rx=0 tx=0).stop 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.170+0000 7fc2cac00640 1 -- 172.21.15.100:0/598771616 shutdown_connections 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.170+0000 7fc2cac00640 1 --2- 172.21.15.100:0/598771616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc2c4074280 0x7fc2c40ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.170+0000 7fc2cac00640 1 --2- 172.21.15.100:0/598771616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2c4155df0 0x7fc2c40730d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.170+0000 7fc2cac00640 1 -- 172.21.15.100:0/598771616 >> 172.21.15.100:0/598771616 conn(0x7fc2c40b1480 msgr2=0x7fc2c40b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.170+0000 7fc2cac00640 1 -- 172.21.15.100:0/598771616 shutdown_connections 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.170+0000 7fc2cac00640 1 -- 172.21.15.100:0/598771616 wait complete. 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.172+0000 7fc2cac00640 1 Processor -- start 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.172+0000 7fc2cac00640 1 -- start start 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2cac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc2c4074280 0x7fc2c41f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2cac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c4155df0 0x7fc2c41524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2cac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2c415c6c0 0x7fc2c406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2cac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c40b2310 con 0x7fc2c4155df0 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2cac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c40cbf60 con 0x7fc2c415c6c0 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2cac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c40ae9d0 con 0x7fc2c4074280 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2c8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c4155df0 0x7fc2c41524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2c8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c4155df0 0x7fc2c41524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58196/0 (socket says 172.21.15.100:58196) 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2c8e00640 1 -- 172.21.15.100:0/71519877 learned_addr learned my addr 172.21.15.100:0/71519877 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2ca200640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2c415c6c0 0x7fc2c406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.173+0000 7fc2c9800640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc2c4074280 0x7fc2c41f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c8e00640 1 -- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc2c4074280 msgr2=0x7fc2c41f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c8e00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc2c4074280 0x7fc2c41f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c8e00640 1 -- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2c415c6c0 msgr2=0x7fc2c406e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c8e00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2c415c6c0 0x7fc2c406e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c8e00640 1 -- 172.21.15.100:0/71519877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c41512a0 con 0x7fc2c4155df0 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c8e00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c4155df0 0x7fc2c41524c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c400 tx=0x7fc2b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c1600640 1 -- 172.21.15.100:0/71519877 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0017070 con 0x7fc2c4155df0 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c1600640 1 -- 172.21.15.100:0/71519877 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2b00053c0 con 0x7fc2c4155df0 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2c1600640 1 -- 172.21.15.100:0/71519877 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0003850 con 0x7fc2c4155df0 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c4151580 con 0x7fc2c4155df0 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.174+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c4151b40 con 0x7fc2c4155df0 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.175+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c40aeef0 con 0x7fc2c4155df0 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.177+0000 7fc2c1600640 1 -- 172.21.15.100:0/71519877 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc2b00039f0 con 0x7fc2c4155df0 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.178+0000 7fc2c1600640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc2a4077fa0 0x7fc2a407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.178+0000 7fc2c1600640 1 -- 172.21.15.100:0/71519877 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fc2b0099580 con 0x7fc2c4155df0 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.178+0000 7fc2c9800640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc2a4077fa0 0x7fc2a407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.179+0000 7fc2c9800640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc2a4077fa0 0x7fc2a407a460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8033000 tx=0x7fc2b8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.182+0000 7fc2c1600640 1 -- 172.21.15.100:0/71519877 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc2b0061800 con 0x7fc2c4155df0 2024-09-10T21:07:11.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.400+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc2c4073e20 con 0x7fc2c4155df0 2024-09-10T21:07:11.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.994+0000 7fc2c1600640 1 -- 172.21.15.100:0/71519877 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fc2b0066230 con 0x7fc2c4155df0 2024-09-10T21:07:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc2a4077fa0 msgr2=0x7fc2a407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc2a4077fa0 0x7fc2a407a460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8033000 tx=0x7fc2b8004730 comp rx=0 tx=0).stop 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c4155df0 msgr2=0x7fc2c41524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c4155df0 0x7fc2c41524c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c400 tx=0x7fc2b000c8c0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 shutdown_connections 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc2a4077fa0 0x7fc2a407a460 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2c415c6c0 0x7fc2c406e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c4155df0 0x7fc2c41524c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 --2- 172.21.15.100:0/71519877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc2c4074280 0x7fc2c41f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.997+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 >> 172.21.15.100:0/71519877 conn(0x7fc2c40b1480 msgr2=0x7fc2c40cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.998+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 shutdown_connections 2024-09-10T21:07:12.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:11.998+0000 7fc2cac00640 1 -- 172.21.15.100:0/71519877 wait complete. 2024-09-10T21:07:12.019 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T21:07:12.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:07:12.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.171+0000 7fc4b2c00640 1 -- 172.21.15.100:0/1437393764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15b680 msgr2=0x7fc4ac15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.171+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/1437393764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15b680 0x7fc4ac15ba60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc49c005fd0 tx=0x7fc49c02a970 comp rx=0 tx=0).stop 2024-09-10T21:07:12.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.171+0000 7fc4b2c00640 1 -- 172.21.15.100:0/1437393764 shutdown_connections 2024-09-10T21:07:12.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.171+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/1437393764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4ac0741e0 0x7fc4ac15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.171+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/1437393764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15b680 0x7fc4ac15ba60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.171+0000 7fc4b2c00640 1 -- 172.21.15.100:0/1437393764 >> 172.21.15.100:0/1437393764 conn(0x7fc4ac06cb50 msgr2=0x7fc4ac06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.171+0000 7fc4b2c00640 1 -- 172.21.15.100:0/1437393764 shutdown_connections 2024-09-10T21:07:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.171+0000 7fc4b2c00640 1 -- 172.21.15.100:0/1437393764 wait complete. 2024-09-10T21:07:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.173+0000 7fc4b2c00640 1 Processor -- start 2024-09-10T21:07:12.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.173+0000 7fc4b2c00640 1 -- start start 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b2c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4ac0741e0 0x7fc4ac14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b2c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4ac15b680 0x7fc4ac15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b2c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15c750 0x7fc4ac15d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b2c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b29e0 con 0x7fc4ac15c750 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b2c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b2860 con 0x7fc4ac0741e0 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b2c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b2b60 con 0x7fc4ac15b680 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15c750 0x7fc4ac15d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15c750 0x7fc4ac15d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32828/0 (socket says 172.21.15.100:32828) 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4b0c00640 1 -- 172.21.15.100:0/4035367228 learned_addr learned my addr 172.21.15.100:0/4035367228 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:12.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4abe00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4ac0741e0 0x7fc4ac14b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.174+0000 7fc4ab400640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4ac15b680 0x7fc4ac15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4b0c00640 1 -- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4ac15b680 msgr2=0x7fc4ac15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4b0c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4ac15b680 0x7fc4ac15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4b0c00640 1 -- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4ac0741e0 msgr2=0x7fc4ac14b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4b0c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4ac0741e0 0x7fc4ac14b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4b0c00640 1 -- 172.21.15.100:0/4035367228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac14b810 con 0x7fc4ac15c750 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4abe00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4ac0741e0 0x7fc4ac14b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4b0c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15c750 0x7fc4ac15d500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400b490 tx=0x7fc4a400b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4a3e00640 1 -- 172.21.15.100:0/4035367228 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4015020 con 0x7fc4ac15c750 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4a3e00640 1 -- 172.21.15.100:0/4035367228 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4a4011940 con 0x7fc4ac15c750 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4a3e00640 1 -- 172.21.15.100:0/4035367228 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4011d90 con 0x7fc4ac15c750 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac1f48a0 con 0x7fc4ac15c750 2024-09-10T21:07:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.175+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac1f4e60 con 0x7fc4ac15c750 2024-09-10T21:07:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.176+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ac0b3090 con 0x7fc4ac15c750 2024-09-10T21:07:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.177+0000 7fc4a3e00640 1 -- 172.21.15.100:0/4035367228 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc4a401a400 con 0x7fc4ac15c750 2024-09-10T21:07:12.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.178+0000 7fc4a3e00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc48c077f70 0x7fc48c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.178+0000 7fc4a3e00640 1 -- 172.21.15.100:0/4035367228 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fc4a409a1b0 con 0x7fc4ac15c750 2024-09-10T21:07:12.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.179+0000 7fc4abe00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc48c077f70 0x7fc48c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.179+0000 7fc4abe00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc48c077f70 0x7fc48c07a430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc49c035000 tx=0x7fc49c004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.183+0000 7fc4a3e00640 1 -- 172.21.15.100:0/4035367228 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc4a401f020 con 0x7fc4ac15c750 2024-09-10T21:07:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.399+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4ac15f7f0 con 0x7fc4ac15c750 2024-09-10T21:07:12.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.399+0000 7fc4a3e00640 1 -- 172.21.15.100:0/4035367228 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7fc4ac14b810 con 0x7fc4ac15c750 2024-09-10T21:07:12.404 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:12.404 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"btime":"2024-09-10T21:07:11:987578+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3760826970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3760826970},{"type":"v1","addr":"172.21.15.100:6834","nonce":3760826970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2104919496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2104919496},{"type":"v1","addr":"172.21.15.130:6837","nonce":2104919496}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2076530872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2076530872},{"type":"v1","addr":"172.21.15.100:6835","nonce":2076530872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:07:08.380674+0000","modified":"2024-09-10T21:07:11.401889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/772903553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":772903553},{"type":"v1","addr":"172.21.15.130:6836","nonce":772903553}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-09-10T21:07:12.404 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-10T21:07:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.401+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc48c077f70 msgr2=0x7fc48c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.401+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc48c077f70 0x7fc48c07a430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc49c035000 tx=0x7fc49c004ab0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.401+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15c750 msgr2=0x7fc4ac15d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.401+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15c750 0x7fc4ac15d500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400b490 tx=0x7fc4a400b950 comp rx=0 tx=0).stop 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.402+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 shutdown_connections 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.402+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ac15c750 0x7fc4ac15d500 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.402+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4ac15b680 0x7fc4ac15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.402+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc48c077f70 0x7fc48c07a430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.402+0000 7fc4b2c00640 1 --2- 172.21.15.100:0/4035367228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4ac0741e0 0x7fc4ac14b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.402+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 >> 172.21.15.100:0/4035367228 conn(0x7fc4ac06cb50 msgr2=0x7fc4ac06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.402+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 shutdown_connections 2024-09-10T21:07:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.402+0000 7fc4b2c00640 1 -- 172.21.15.100:0/4035367228 wait complete. 2024-09-10T21:07:12.423 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:07:12.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.576+0000 7f6a11e00640 1 -- 172.21.15.100:0/3354299513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15b680 msgr2=0x7f6a0c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.576+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3354299513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15b680 0x7f6a0c15ba60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0cd2b0 tx=0x7f69fc02a4d0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.576+0000 7f6a11e00640 1 -- 172.21.15.100:0/3354299513 shutdown_connections 2024-09-10T21:07:12.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.576+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3354299513 >> v2:172.21.15.130:3300/0 conn(0x7f6a0c15c750 0x7f6a0c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.576+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3354299513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15b680 0x7f6a0c15ba60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.576+0000 7f6a11e00640 1 -- 172.21.15.100:0/3354299513 >> 172.21.15.100:0/3354299513 conn(0x7f6a0c06cb50 msgr2=0x7f6a0c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:12.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.576+0000 7f6a11e00640 1 -- 172.21.15.100:0/3354299513 shutdown_connections 2024-09-10T21:07:12.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.576+0000 7f6a11e00640 1 -- 172.21.15.100:0/3354299513 wait complete. 2024-09-10T21:07:12.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.578+0000 7f6a11e00640 1 Processor -- start 2024-09-10T21:07:12.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.578+0000 7f6a11e00640 1 -- start start 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a11e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a0c0741e0 0x7f6a0c1482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a11e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a0c15b680 0x7f6a0c0b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a11e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15c750 0x7f6a0c0b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a11e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c0b2860 con 0x7f6a0c15c750 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a11e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c0b29e0 con 0x7f6a0c0741e0 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a11e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0c0b2b60 con 0x7f6a0c15b680 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15c750 0x7f6a0c0b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15c750 0x7f6a0c0b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32858/0 (socket says 172.21.15.100:32858) 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0b400640 1 -- 172.21.15.100:0/3608918298 learned_addr learned my addr 172.21.15.100:0/3608918298 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:12.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0aa00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a0c0741e0 0x7f6a0c1482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0b400640 1 -- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a0c15b680 msgr2=0x7f6a0c0b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0b400640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a0c15b680 0x7f6a0c0b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0b400640 1 -- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a0c0741e0 msgr2=0x7f6a0c1482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0b400640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a0c0741e0 0x7f6a0c1482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.579+0000 7f6a0b400640 1 -- 172.21.15.100:0/3608918298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c06f0c0 con 0x7f6a0c15c750 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.580+0000 7f6a0aa00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a0c0741e0 0x7f6a0c1482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.580+0000 7f6a0b400640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15c750 0x7f6a0c0b1e50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400cb00 tx=0x7f6a0400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.580+0000 7f6a03400640 1 -- 172.21.15.100:0/3608918298 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400f450 con 0x7f6a0c15c750 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.580+0000 7f6a03400640 1 -- 172.21.15.100:0/3608918298 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a0400f700 con 0x7f6a0c15c750 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.580+0000 7f6a03400640 1 -- 172.21.15.100:0/3608918298 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400fb50 con 0x7f6a0c15c750 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.580+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c06f3a0 con 0x7f6a0c15c750 2024-09-10T21:07:12.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.580+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c06f960 con 0x7f6a0c15c750 2024-09-10T21:07:12.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.581+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c1556e0 con 0x7f6a0c15c750 2024-09-10T21:07:12.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.582+0000 7f6a03400640 1 -- 172.21.15.100:0/3608918298 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6a0400e3b0 con 0x7f6a0c15c750 2024-09-10T21:07:12.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.583+0000 7f6a03400640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69ec077f70 0x7f69ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.583+0000 7f6a03400640 1 -- 172.21.15.100:0/3608918298 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f6a0409aba0 con 0x7f6a0c15c750 2024-09-10T21:07:12.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.584+0000 7f6a0aa00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69ec077f70 0x7f69ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.585+0000 7f6a0aa00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69ec077f70 0x7f69ec07a430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f69fc033000 tx=0x7f69fc004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:12.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.587+0000 7f6a03400640 1 -- 172.21.15.100:0/3608918298 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6a0c1556e0 con 0x7f6a0c15c750 2024-09-10T21:07:12.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.771+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a0c06cf30 con 0x7f6a0c15c750 2024-09-10T21:07:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.772+0000 7f6a03400640 1 -- 172.21.15.100:0/3608918298 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17026 (secure 0 0 0) 0x7f6a0c06cf30 con 0x7f6a0c15c750 2024-09-10T21:07:12.777 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:12.778 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:07:09.973363+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:07:06.699580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T21:07:07.345691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:07:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69ec077f70 msgr2=0x7f69ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69ec077f70 0x7f69ec07a430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f69fc033000 tx=0x7f69fc004730 comp rx=0 tx=0).stop 2024-09-10T21:07:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15c750 msgr2=0x7f6a0c0b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15c750 0x7f6a0c0b1e50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400cb00 tx=0x7f6a0400a250 comp rx=0 tx=0).stop 2024-09-10T21:07:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 shutdown_connections 2024-09-10T21:07:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a0c15c750 0x7f6a0c0b1e50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a0c15b680 0x7f6a0c0b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f69ec077f70 0x7f69ec07a430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 --2- 172.21.15.100:0/3608918298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a0c0741e0 0x7f6a0c1482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 >> 172.21.15.100:0/3608918298 conn(0x7f6a0c06cb50 msgr2=0x7f6a0c154fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:12.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 shutdown_connections 2024-09-10T21:07:12.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.775+0000 7f6a11e00640 1 -- 172.21.15.100:0/3608918298 wait complete. 2024-09-10T21:07:12.796 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T21:07:12.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 -- 172.21.15.100:0/662589929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 msgr2=0x7ff9d80cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 --2- 172.21.15.100:0/662589929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 0x7ff9d80cf780 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8070960 tx=0x7ff9d002a560 comp rx=0 tx=0).stop 2024-09-10T21:07:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 -- 172.21.15.100:0/662589929 shutdown_connections 2024-09-10T21:07:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 --2- 172.21.15.100:0/662589929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 0x7ff9d80cf780 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 --2- 172.21.15.100:0/662589929 >> v2:172.21.15.130:3300/0 conn(0x7ff9d80741e0 0x7ff9d815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 --2- 172.21.15.100:0/662589929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9d815b680 0x7ff9d815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 -- 172.21.15.100:0/662589929 >> 172.21.15.100:0/662589929 conn(0x7ff9d806cb50 msgr2=0x7ff9d806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 -- 172.21.15.100:0/662589929 shutdown_connections 2024-09-10T21:07:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.946+0000 7ff9e0000640 1 -- 172.21.15.100:0/662589929 wait complete. 2024-09-10T21:07:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.948+0000 7ff9e0000640 1 Processor -- start 2024-09-10T21:07:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.948+0000 7ff9e0000640 1 -- start start 2024-09-10T21:07:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9e0000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d80741e0 0x7ff9d8148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9e0000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9d815b680 0x7ff9d80c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9e0000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 0x7ff9d814af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9e0000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d80d00d0 con 0x7ff9d815c750 2024-09-10T21:07:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9e0000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d80cff50 con 0x7ff9d80741e0 2024-09-10T21:07:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9e0000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d80b2860 con 0x7ff9d815b680 2024-09-10T21:07:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9de000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 0x7ff9d814af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9de000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 0x7ff9d814af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32888/0 (socket says 172.21.15.100:32888) 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.949+0000 7ff9de000640 1 -- 172.21.15.100:0/2162951082 learned_addr learned my addr 172.21.15.100:0/2162951082 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9dd600640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d80741e0 0x7ff9d8148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9dcc00640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9d815b680 0x7ff9d80c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9de000640 1 -- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9d815b680 msgr2=0x7ff9d80c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9de000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9d815b680 0x7ff9d80c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9de000640 1 -- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d80741e0 msgr2=0x7ff9d8148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9de000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d80741e0 0x7ff9d8148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9de000640 1 -- 172.21.15.100:0/2162951082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d81f3e30 con 0x7ff9d815c750 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9dcc00640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9d815b680 0x7ff9d80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9de000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 0x7ff9d814af40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0034040 tx=0x7ff9d0003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9d5600640 1 -- 172.21.15.100:0/2162951082 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d003e030 con 0x7ff9d815c750 2024-09-10T21:07:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9d5600640 1 -- 172.21.15.100:0/2162951082 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d0003e50 con 0x7ff9d815c750 2024-09-10T21:07:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9d5600640 1 -- 172.21.15.100:0/2162951082 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0035040 con 0x7ff9d815c750 2024-09-10T21:07:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d8158d10 con 0x7ff9d815c750 2024-09-10T21:07:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.950+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d81592d0 con 0x7ff9d815c750 2024-09-10T21:07:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.951+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d815ba60 con 0x7ff9d815c750 2024-09-10T21:07:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.952+0000 7ff9d5600640 1 -- 172.21.15.100:0/2162951082 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff9d0004a00 con 0x7ff9d815c750 2024-09-10T21:07:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.953+0000 7ff9d5600640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9b8077f70 0x7ff9b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.953+0000 7ff9d5600640 1 -- 172.21.15.100:0/2162951082 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7ff9d00ba950 con 0x7ff9d815c750 2024-09-10T21:07:12.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.954+0000 7ff9dd600640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9b8077f70 0x7ff9b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:12.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.955+0000 7ff9dd600640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9b8077f70 0x7ff9b807a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc007350 tx=0x7ff9cc0072e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:12.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:12.959+0000 7ff9d5600640 1 -- 172.21.15.100:0/2162951082 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff9d00832b0 con 0x7ff9d815c750 2024-09-10T21:07:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.156+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9d80cc490 con 0x7ff9b8077f70 2024-09-10T21:07:13.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.161+0000 7ff9d5600640 1 -- 172.21.15.100:0/2162951082 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251208 (secure 0 0 0) 0x7ff9d80cc490 con 0x7ff9b8077f70 2024-09-10T21:07:13.170 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:13.171 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.165+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9b8077f70 msgr2=0x7ff9b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.165+0000 7ff9e0000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9b8077f70 0x7ff9b807a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc007350 tx=0x7ff9cc0072e0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.165+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 msgr2=0x7ff9d814af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.165+0000 7ff9e0000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 0x7ff9d814af40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0034040 tx=0x7ff9d0003960 comp rx=0 tx=0).stop 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.165+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 shutdown_connections 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.165+0000 7ff9e0000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d815c750 0x7ff9d814af40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.165+0000 7ff9e0000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9d815b680 0x7ff9d80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.165+0000 7ff9e0000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff9b8077f70 0x7ff9b807a430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.166+0000 7ff9e0000640 1 --2- 172.21.15.100:0/2162951082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9d80741e0 0x7ff9d8148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.166+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 >> 172.21.15.100:0/2162951082 conn(0x7ff9d806cb50 msgr2=0x7ff9d80b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.166+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 shutdown_connections 2024-09-10T21:07:13.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.166+0000 7ff9e0000640 1 -- 172.21.15.100:0/2162951082 wait complete. 2024-09-10T21:07:13.186 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-10T21:07:12.704101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221048,"kb_used_data":4796,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753672,"statfs":{"total":773094113280,"available":772867760128,"internally_reserved":0,"allocated":4911104,"data_stored":2746300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750773"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006398+0000","last_change":"2024-09-10T21:07:08.993655+0000","last_active":"2024-09-10T21:07:09.006398+0000","last_peered":"2024-09-10T21:07:09.006398+0000","last_clean":"2024-09-10T21:07:09.006398+0000","last_became_active":"2024-09-10T21:07:08.991972+0000","last_became_peered":"2024-09-10T21:07:08.991972+0000","last_unstale":"2024-09-10T21:07:09.006398+0000","last_undegraded":"2024-09-10T21:07:09.006398+0000","last_fullsized":"2024-09-10T21:07:09.006398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:42.045631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983097+0000","last_change":"2024-09-10T21:07:08.993612+0000","last_active":"2024-09-10T21:07:09.983097+0000","last_peered":"2024-09-10T21:07:09.983097+0000","last_clean":"2024-09-10T21:07:09.983097+0000","last_became_active":"2024-09-10T21:07:08.993291+0000","last_became_peered":"2024-09-10T21:07:08.993291+0000","last_unstale":"2024-09-10T21:07:09.983097+0000","last_undegraded":"2024-09-10T21:07:09.983097+0000","last_fullsized":"2024-09-10T21:07:09.983097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.998149+0000","last_change":"2024-09-10T21:07:08.986654+0000","last_active":"2024-09-10T21:07:08.998149+0000","last_peered":"2024-09-10T21:07:08.998149+0000","last_clean":"2024-09-10T21:07:08.998149+0000","last_became_active":"2024-09-10T21:07:08.986313+0000","last_became_peered":"2024-09-10T21:07:08.986313+0000","last_unstale":"2024-09-10T21:07:08.998149+0000","last_undegraded":"2024-09-10T21:07:08.998149+0000","last_fullsized":"2024-09-10T21:07:08.998149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.007251+0000","last_change":"2024-09-10T21:07:08.992089+0000","last_active":"2024-09-10T21:07:09.007251+0000","last_peered":"2024-09-10T21:07:09.007251+0000","last_clean":"2024-09-10T21:07:09.007251+0000","last_became_active":"2024-09-10T21:07:08.991795+0000","last_became_peered":"2024-09-10T21:07:08.991795+0000","last_unstale":"2024-09-10T21:07:09.007251+0000","last_undegraded":"2024-09-10T21:07:09.007251+0000","last_fullsized":"2024-09-10T21:07:09.007251+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983410+0000","last_change":"2024-09-10T21:07:09.006257+0000","last_active":"2024-09-10T21:07:09.983410+0000","last_peered":"2024-09-10T21:07:09.983410+0000","last_clean":"2024-09-10T21:07:09.983410+0000","last_became_active":"2024-09-10T21:07:09.005851+0000","last_became_peered":"2024-09-10T21:07:09.005851+0000","last_unstale":"2024-09-10T21:07:09.983410+0000","last_undegraded":"2024-09-10T21:07:09.983410+0000","last_fullsized":"2024-09-10T21:07:09.983410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981787+0000","last_change":"2024-09-10T21:07:08.985543+0000","last_active":"2024-09-10T21:07:09.981787+0000","last_peered":"2024-09-10T21:07:09.981787+0000","last_clean":"2024-09-10T21:07:09.981787+0000","last_became_active":"2024-09-10T21:07:08.981933+0000","last_became_peered":"2024-09-10T21:07:08.981933+0000","last_unstale":"2024-09-10T21:07:09.981787+0000","last_undegraded":"2024-09-10T21:07:09.981787+0000","last_fullsized":"2024-09-10T21:07:09.981787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:55.184003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982434+0000","last_change":"2024-09-10T21:07:08.991775+0000","last_active":"2024-09-10T21:07:09.982434+0000","last_peered":"2024-09-10T21:07:09.982434+0000","last_clean":"2024-09-10T21:07:09.982434+0000","last_became_active":"2024-09-10T21:07:08.991499+0000","last_became_peered":"2024-09-10T21:07:08.991499+0000","last_unstale":"2024-09-10T21:07:09.982434+0000","last_undegraded":"2024-09-10T21:07:09.982434+0000","last_fullsized":"2024-09-10T21:07:09.982434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008785+0000","last_change":"2024-09-10T21:07:09.003113+0000","last_active":"2024-09-10T21:07:09.008785+0000","last_peered":"2024-09-10T21:07:09.008785+0000","last_clean":"2024-09-10T21:07:09.008785+0000","last_became_active":"2024-09-10T21:07:09.002875+0000","last_became_peered":"2024-09-10T21:07:09.002875+0000","last_unstale":"2024-09-10T21:07:09.008785+0000","last_undegraded":"2024-09-10T21:07:09.008785+0000","last_fullsized":"2024-09-10T21:07:09.008785+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:25.364850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983824+0000","last_change":"2024-09-10T21:07:08.995695+0000","last_active":"2024-09-10T21:07:09.983824+0000","last_peered":"2024-09-10T21:07:09.983824+0000","last_clean":"2024-09-10T21:07:09.983824+0000","last_became_active":"2024-09-10T21:07:08.995450+0000","last_became_peered":"2024-09-10T21:07:08.995450+0000","last_unstale":"2024-09-10T21:07:09.983824+0000","last_undegraded":"2024-09-10T21:07:09.983824+0000","last_fullsized":"2024-09-10T21:07:09.983824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982683+0000","last_change":"2024-09-10T21:07:08.987778+0000","last_active":"2024-09-10T21:07:09.982683+0000","last_peered":"2024-09-10T21:07:09.982683+0000","last_clean":"2024-09-10T21:07:09.982683+0000","last_became_active":"2024-09-10T21:07:08.987558+0000","last_became_peered":"2024-09-10T21:07:08.987558+0000","last_unstale":"2024-09-10T21:07:09.982683+0000","last_undegraded":"2024-09-10T21:07:09.982683+0000","last_fullsized":"2024-09-10T21:07:09.982683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:26.013241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988586+0000","last_change":"2024-09-10T21:07:09.004347+0000","last_active":"2024-09-10T21:07:09.988586+0000","last_peered":"2024-09-10T21:07:09.988586+0000","last_clean":"2024-09-10T21:07:09.988586+0000","last_became_active":"2024-09-10T21:07:09.004076+0000","last_became_peered":"2024-09-10T21:07:09.004076+0000","last_unstale":"2024-09-10T21:07:09.988586+0000","last_undegraded":"2024-09-10T21:07:09.988586+0000","last_fullsized":"2024-09-10T21:07:09.988586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983673+0000","last_change":"2024-09-10T21:07:09.001468+0000","last_active":"2024-09-10T21:07:09.983673+0000","last_peered":"2024-09-10T21:07:09.983673+0000","last_clean":"2024-09-10T21:07:09.983673+0000","last_became_active":"2024-09-10T21:07:09.001207+0000","last_became_peered":"2024-09-10T21:07:09.001207+0000","last_unstale":"2024-09-10T21:07:09.983673+0000","last_undegraded":"2024-09-10T21:07:09.983673+0000","last_fullsized":"2024-09-10T21:07:09.983673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982349+0000","last_change":"2024-09-10T21:07:08.995284+0000","last_active":"2024-09-10T21:07:09.982349+0000","last_peered":"2024-09-10T21:07:09.982349+0000","last_clean":"2024-09-10T21:07:09.982349+0000","last_became_active":"2024-09-10T21:07:08.994529+0000","last_became_peered":"2024-09-10T21:07:08.994529+0000","last_unstale":"2024-09-10T21:07:09.982349+0000","last_undegraded":"2024-09-10T21:07:09.982349+0000","last_fullsized":"2024-09-10T21:07:09.982349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.002042+0000","last_change":"2024-09-10T21:07:08.988477+0000","last_active":"2024-09-10T21:07:09.002042+0000","last_peered":"2024-09-10T21:07:09.002042+0000","last_clean":"2024-09-10T21:07:09.002042+0000","last_became_active":"2024-09-10T21:07:08.988146+0000","last_became_peered":"2024-09-10T21:07:08.988146+0000","last_unstale":"2024-09-10T21:07:09.002042+0000","last_undegraded":"2024-09-10T21:07:09.002042+0000","last_fullsized":"2024-09-10T21:07:09.002042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:37.378222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.998634+0000","last_change":"2024-09-10T21:07:08.992983+0000","last_active":"2024-09-10T21:07:08.998634+0000","last_peered":"2024-09-10T21:07:08.998634+0000","last_clean":"2024-09-10T21:07:08.998634+0000","last_became_active":"2024-09-10T21:07:08.992683+0000","last_became_peered":"2024-09-10T21:07:08.992683+0000","last_unstale":"2024-09-10T21:07:08.998634+0000","last_undegraded":"2024-09-10T21:07:08.998634+0000","last_fullsized":"2024-09-10T21:07:08.998634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:35.716765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982205+0000","last_change":"2024-09-10T21:07:08.982108+0000","last_active":"2024-09-10T21:07:09.982205+0000","last_peered":"2024-09-10T21:07:09.982205+0000","last_clean":"2024-09-10T21:07:09.982205+0000","last_became_active":"2024-09-10T21:07:08.981887+0000","last_became_peered":"2024-09-10T21:07:08.981887+0000","last_unstale":"2024-09-10T21:07:09.982205+0000","last_undegraded":"2024-09-10T21:07:09.982205+0000","last_fullsized":"2024-09-10T21:07:09.982205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991780+0000","last_change":"2024-09-10T21:07:08.986295+0000","last_active":"2024-09-10T21:07:08.991780+0000","last_peered":"2024-09-10T21:07:08.991780+0000","last_clean":"2024-09-10T21:07:08.991780+0000","last_became_active":"2024-09-10T21:07:08.983589+0000","last_became_peered":"2024-09-10T21:07:08.983589+0000","last_unstale":"2024-09-10T21:07:08.991780+0000","last_undegraded":"2024-09-10T21:07:08.991780+0000","last_fullsized":"2024-09-10T21:07:08.991780+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:04.873265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991889+0000","last_change":"2024-09-10T21:07:08.987716+0000","last_active":"2024-09-10T21:07:08.991889+0000","last_peered":"2024-09-10T21:07:08.991889+0000","last_clean":"2024-09-10T21:07:08.991889+0000","last_became_active":"2024-09-10T21:07:08.986131+0000","last_became_peered":"2024-09-10T21:07:08.986131+0000","last_unstale":"2024-09-10T21:07:08.991889+0000","last_undegraded":"2024-09-10T21:07:08.991889+0000","last_fullsized":"2024-09-10T21:07:08.991889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:55.256639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988341+0000","last_change":"2024-09-10T21:07:08.989449+0000","last_active":"2024-09-10T21:07:09.988341+0000","last_peered":"2024-09-10T21:07:09.988341+0000","last_clean":"2024-09-10T21:07:09.988341+0000","last_became_active":"2024-09-10T21:07:08.988365+0000","last_became_peered":"2024-09-10T21:07:08.988365+0000","last_unstale":"2024-09-10T21:07:09.988341+0000","last_undegraded":"2024-09-10T21:07:09.988341+0000","last_fullsized":"2024-09-10T21:07:09.988341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:15.897184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988657+0000","last_change":"2024-09-10T21:07:08.984966+0000","last_active":"2024-09-10T21:07:09.988657+0000","last_peered":"2024-09-10T21:07:09.988657+0000","last_clean":"2024-09-10T21:07:09.988657+0000","last_became_active":"2024-09-10T21:07:08.984696+0000","last_became_peered":"2024-09-10T21:07:08.984696+0000","last_unstale":"2024-09-10T21:07:09.988657+0000","last_undegraded":"2024-09-10T21:07:09.988657+0000","last_fullsized":"2024-09-10T21:07:09.988657+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:48.470274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988163+0000","last_change":"2024-09-10T21:07:08.992572+0000","last_active":"2024-09-10T21:07:09.988163+0000","last_peered":"2024-09-10T21:07:09.988163+0000","last_clean":"2024-09-10T21:07:09.988163+0000","last_became_active":"2024-09-10T21:07:08.992231+0000","last_became_peered":"2024-09-10T21:07:08.992231+0000","last_unstale":"2024-09-10T21:07:09.988163+0000","last_undegraded":"2024-09-10T21:07:09.988163+0000","last_fullsized":"2024-09-10T21:07:09.988163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.996609+0000","last_change":"2024-09-10T21:07:08.990954+0000","last_active":"2024-09-10T21:07:08.996609+0000","last_peered":"2024-09-10T21:07:08.996609+0000","last_clean":"2024-09-10T21:07:08.996609+0000","last_became_active":"2024-09-10T21:07:08.989166+0000","last_became_peered":"2024-09-10T21:07:08.989166+0000","last_unstale":"2024-09-10T21:07:08.996609+0000","last_undegraded":"2024-09-10T21:07:08.996609+0000","last_fullsized":"2024-09-10T21:07:08.996609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:48.434984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008398+0000","last_change":"2024-09-10T21:07:08.998488+0000","last_active":"2024-09-10T21:07:09.008398+0000","last_peered":"2024-09-10T21:07:09.008398+0000","last_clean":"2024-09-10T21:07:09.008398+0000","last_became_active":"2024-09-10T21:07:08.997677+0000","last_became_peered":"2024-09-10T21:07:08.997677+0000","last_unstale":"2024-09-10T21:07:09.008398+0000","last_undegraded":"2024-09-10T21:07:09.008398+0000","last_fullsized":"2024-09-10T21:07:09.008398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:06:30.641657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008530+0000","last_change":"2024-09-10T21:07:09.003139+0000","last_active":"2024-09-10T21:07:09.008530+0000","last_peered":"2024-09-10T21:07:09.008530+0000","last_clean":"2024-09-10T21:07:09.008530+0000","last_became_active":"2024-09-10T21:07:09.002972+0000","last_became_peered":"2024-09-10T21:07:09.002972+0000","last_unstale":"2024-09-10T21:07:09.008530+0000","last_undegraded":"2024-09-10T21:07:09.008530+0000","last_fullsized":"2024-09-10T21:07:09.008530+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008454+0000","last_change":"2024-09-10T21:07:08.998658+0000","last_active":"2024-09-10T21:07:09.008454+0000","last_peered":"2024-09-10T21:07:09.008454+0000","last_clean":"2024-09-10T21:07:09.008454+0000","last_became_active":"2024-09-10T21:07:08.993838+0000","last_became_peered":"2024-09-10T21:07:08.993838+0000","last_unstale":"2024-09-10T21:07:09.008454+0000","last_undegraded":"2024-09-10T21:07:09.008454+0000","last_fullsized":"2024-09-10T21:07:09.008454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988654+0000","last_change":"2024-09-10T21:07:08.997383+0000","last_active":"2024-09-10T21:07:09.988654+0000","last_peered":"2024-09-10T21:07:09.988654+0000","last_clean":"2024-09-10T21:07:09.988654+0000","last_became_active":"2024-09-10T21:07:08.997089+0000","last_became_peered":"2024-09-10T21:07:08.997089+0000","last_unstale":"2024-09-10T21:07:09.988654+0000","last_undegraded":"2024-09-10T21:07:09.988654+0000","last_fullsized":"2024-09-10T21:07:09.988654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982632+0000","last_change":"2024-09-10T21:07:08.993822+0000","last_active":"2024-09-10T21:07:09.982632+0000","last_peered":"2024-09-10T21:07:09.982632+0000","last_clean":"2024-09-10T21:07:09.982632+0000","last_became_active":"2024-09-10T21:07:08.991716+0000","last_became_peered":"2024-09-10T21:07:08.991716+0000","last_unstale":"2024-09-10T21:07:09.982632+0000","last_undegraded":"2024-09-10T21:07:09.982632+0000","last_fullsized":"2024-09-10T21:07:09.982632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993244+0000","last_change":"2024-09-10T21:07:08.988982+0000","last_active":"2024-09-10T21:07:08.993244+0000","last_peered":"2024-09-10T21:07:08.993244+0000","last_clean":"2024-09-10T21:07:08.993244+0000","last_became_active":"2024-09-10T21:07:08.988654+0000","last_became_peered":"2024-09-10T21:07:08.988654+0000","last_unstale":"2024-09-10T21:07:08.993244+0000","last_undegraded":"2024-09-10T21:07:08.993244+0000","last_fullsized":"2024-09-10T21:07:08.993244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:46.803121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993168+0000","last_change":"2024-09-10T21:07:08.989788+0000","last_active":"2024-09-10T21:07:08.993168+0000","last_peered":"2024-09-10T21:07:08.993168+0000","last_clean":"2024-09-10T21:07:08.993168+0000","last_became_active":"2024-09-10T21:07:08.988825+0000","last_became_peered":"2024-09-10T21:07:08.988825+0000","last_unstale":"2024-09-10T21:07:08.993168+0000","last_undegraded":"2024-09-10T21:07:08.993168+0000","last_fullsized":"2024-09-10T21:07:08.993168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.855818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982533+0000","last_change":"2024-09-10T21:07:08.982659+0000","last_active":"2024-09-10T21:07:09.982533+0000","last_peered":"2024-09-10T21:07:09.982533+0000","last_clean":"2024-09-10T21:07:09.982533+0000","last_became_active":"2024-09-10T21:07:08.982365+0000","last_became_peered":"2024-09-10T21:07:08.982365+0000","last_unstale":"2024-09-10T21:07:09.982533+0000","last_undegraded":"2024-09-10T21:07:09.982533+0000","last_fullsized":"2024-09-10T21:07:09.982533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008381+0000","last_change":"2024-09-10T21:07:08.998256+0000","last_active":"2024-09-10T21:07:09.008381+0000","last_peered":"2024-09-10T21:07:09.008381+0000","last_clean":"2024-09-10T21:07:09.008381+0000","last_became_active":"2024-09-10T21:07:08.994815+0000","last_became_peered":"2024-09-10T21:07:08.994815+0000","last_unstale":"2024-09-10T21:07:09.008381+0000","last_undegraded":"2024-09-10T21:07:09.008381+0000","last_fullsized":"2024-09-10T21:07:09.008381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993127+0000","last_change":"2024-09-10T21:07:08.989239+0000","last_active":"2024-09-10T21:07:08.993127+0000","last_peered":"2024-09-10T21:07:08.993127+0000","last_clean":"2024-09-10T21:07:08.993127+0000","last_became_active":"2024-09-10T21:07:08.988990+0000","last_became_peered":"2024-09-10T21:07:08.988990+0000","last_unstale":"2024-09-10T21:07:08.993127+0000","last_undegraded":"2024-09-10T21:07:08.993127+0000","last_fullsized":"2024-09-10T21:07:08.993127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:06.536654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.013538+0000","last_change":"2024-09-10T21:07:07.982303+0000","last_active":"2024-09-10T21:07:09.013538+0000","last_peered":"2024-09-10T21:07:09.013538+0000","last_clean":"2024-09-10T21:07:09.013538+0000","last_became_active":"2024-09-10T21:07:07.982051+0000","last_became_peered":"2024-09-10T21:07:07.982051+0000","last_unstale":"2024-09-10T21:07:09.013538+0000","last_undegraded":"2024-09-10T21:07:09.013538+0000","last_fullsized":"2024-09-10T21:07:09.013538+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:36.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982710+0000","last_change":"2024-09-10T21:07:08.989864+0000","last_active":"2024-09-10T21:07:09.982710+0000","last_peered":"2024-09-10T21:07:09.982710+0000","last_clean":"2024-09-10T21:07:09.982710+0000","last_became_active":"2024-09-10T21:07:08.989615+0000","last_became_peered":"2024-09-10T21:07:08.989615+0000","last_unstale":"2024-09-10T21:07:09.982710+0000","last_undegraded":"2024-09-10T21:07:09.982710+0000","last_fullsized":"2024-09-10T21:07:09.982710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982909+0000","last_change":"2024-09-10T21:07:07.975121+0000","last_active":"2024-09-10T21:07:09.982909+0000","last_peered":"2024-09-10T21:07:09.982909+0000","last_clean":"2024-09-10T21:07:09.982909+0000","last_became_active":"2024-09-10T21:07:07.974854+0000","last_became_peered":"2024-09-10T21:07:07.974854+0000","last_unstale":"2024-09-10T21:07:09.982909+0000","last_undegraded":"2024-09-10T21:07:09.982909+0000","last_fullsized":"2024-09-10T21:07:09.982909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991864+0000","last_change":"2024-09-10T21:07:08.984081+0000","last_active":"2024-09-10T21:07:08.991864+0000","last_peered":"2024-09-10T21:07:08.991864+0000","last_clean":"2024-09-10T21:07:08.991864+0000","last_became_active":"2024-09-10T21:07:08.983081+0000","last_became_peered":"2024-09-10T21:07:08.983081+0000","last_unstale":"2024-09-10T21:07:08.991864+0000","last_undegraded":"2024-09-10T21:07:08.991864+0000","last_fullsized":"2024-09-10T21:07:08.991864+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:14.488707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006307+0000","last_change":"2024-09-10T21:07:07.974937+0000","last_active":"2024-09-10T21:07:09.006307+0000","last_peered":"2024-09-10T21:07:09.006307+0000","last_clean":"2024-09-10T21:07:09.006307+0000","last_became_active":"2024-09-10T21:07:07.973491+0000","last_became_peered":"2024-09-10T21:07:07.973491+0000","last_unstale":"2024-09-10T21:07:09.006307+0000","last_undegraded":"2024-09-10T21:07:09.006307+0000","last_fullsized":"2024-09-10T21:07:09.006307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:28.408739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982984+0000","last_change":"2024-09-10T21:07:08.989505+0000","last_active":"2024-09-10T21:07:09.982984+0000","last_peered":"2024-09-10T21:07:09.982984+0000","last_clean":"2024-09-10T21:07:09.982984+0000","last_became_active":"2024-09-10T21:07:08.988284+0000","last_became_peered":"2024-09-10T21:07:08.988284+0000","last_unstale":"2024-09-10T21:07:09.982984+0000","last_undegraded":"2024-09-10T21:07:09.982984+0000","last_fullsized":"2024-09-10T21:07:09.982984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009024+0000","last_change":"2024-09-10T21:07:07.983144+0000","last_active":"2024-09-10T21:07:09.009024+0000","last_peered":"2024-09-10T21:07:09.009024+0000","last_clean":"2024-09-10T21:07:09.009024+0000","last_became_active":"2024-09-10T21:07:07.982903+0000","last_became_peered":"2024-09-10T21:07:07.982903+0000","last_unstale":"2024-09-10T21:07:09.009024+0000","last_undegraded":"2024-09-10T21:07:09.009024+0000","last_fullsized":"2024-09-10T21:07:09.009024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008357+0000","last_change":"2024-09-10T21:07:08.997979+0000","last_active":"2024-09-10T21:07:09.008357+0000","last_peered":"2024-09-10T21:07:09.008357+0000","last_clean":"2024-09-10T21:07:09.008357+0000","last_became_active":"2024-09-10T21:07:08.994323+0000","last_became_peered":"2024-09-10T21:07:08.994323+0000","last_unstale":"2024-09-10T21:07:09.008357+0000","last_undegraded":"2024-09-10T21:07:09.008357+0000","last_fullsized":"2024-09-10T21:07:09.008357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.005693+0000","last_change":"2024-09-10T21:07:07.980708+0000","last_active":"2024-09-10T21:07:09.005693+0000","last_peered":"2024-09-10T21:07:09.005693+0000","last_clean":"2024-09-10T21:07:09.005693+0000","last_became_active":"2024-09-10T21:07:07.980440+0000","last_became_peered":"2024-09-10T21:07:07.980440+0000","last_unstale":"2024-09-10T21:07:09.005693+0000","last_undegraded":"2024-09-10T21:07:09.005693+0000","last_fullsized":"2024-09-10T21:07:09.005693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:25.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988142+0000","last_change":"2024-09-10T21:07:08.997562+0000","last_active":"2024-09-10T21:07:09.988142+0000","last_peered":"2024-09-10T21:07:09.988142+0000","last_clean":"2024-09-10T21:07:09.988142+0000","last_became_active":"2024-09-10T21:07:08.997293+0000","last_became_peered":"2024-09-10T21:07:08.997293+0000","last_unstale":"2024-09-10T21:07:09.988142+0000","last_undegraded":"2024-09-10T21:07:09.988142+0000","last_fullsized":"2024-09-10T21:07:09.988142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982325+0000","last_change":"2024-09-10T21:07:07.977927+0000","last_active":"2024-09-10T21:07:09.982325+0000","last_peered":"2024-09-10T21:07:09.982325+0000","last_clean":"2024-09-10T21:07:09.982325+0000","last_became_active":"2024-09-10T21:07:07.976343+0000","last_became_peered":"2024-09-10T21:07:07.976343+0000","last_unstale":"2024-09-10T21:07:09.982325+0000","last_undegraded":"2024-09-10T21:07:09.982325+0000","last_fullsized":"2024-09-10T21:07:09.982325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:13.035700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.984081+0000","last_change":"2024-09-10T21:07:08.981362+0000","last_active":"2024-09-10T21:07:08.984081+0000","last_peered":"2024-09-10T21:07:08.984081+0000","last_clean":"2024-09-10T21:07:08.984081+0000","last_became_active":"2024-09-10T21:07:08.981095+0000","last_became_peered":"2024-09-10T21:07:08.981095+0000","last_unstale":"2024-09-10T21:07:08.984081+0000","last_undegraded":"2024-09-10T21:07:08.984081+0000","last_fullsized":"2024-09-10T21:07:08.984081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:24.429348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.979079+0000","last_change":"2024-09-10T21:07:07.974482+0000","last_active":"2024-09-10T21:07:08.979079+0000","last_peered":"2024-09-10T21:07:08.979079+0000","last_clean":"2024-09-10T21:07:08.979079+0000","last_became_active":"2024-09-10T21:07:07.974215+0000","last_became_peered":"2024-09-10T21:07:07.974215+0000","last_unstale":"2024-09-10T21:07:08.979079+0000","last_undegraded":"2024-09-10T21:07:08.979079+0000","last_fullsized":"2024-09-10T21:07:08.979079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:07.774238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982188+0000","last_change":"2024-09-10T21:07:08.990378+0000","last_active":"2024-09-10T21:07:09.982188+0000","last_peered":"2024-09-10T21:07:09.982188+0000","last_clean":"2024-09-10T21:07:09.982188+0000","last_became_active":"2024-09-10T21:07:08.990072+0000","last_became_peered":"2024-09-10T21:07:08.990072+0000","last_unstale":"2024-09-10T21:07:09.982188+0000","last_undegraded":"2024-09-10T21:07:09.982188+0000","last_fullsized":"2024-09-10T21:07:09.982188+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:58.604705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982138+0000","last_change":"2024-09-10T21:07:07.975095+0000","last_active":"2024-09-10T21:07:09.982138+0000","last_peered":"2024-09-10T21:07:09.982138+0000","last_clean":"2024-09-10T21:07:09.982138+0000","last_became_active":"2024-09-10T21:07:07.974845+0000","last_became_peered":"2024-09-10T21:07:07.974845+0000","last_unstale":"2024-09-10T21:07:09.982138+0000","last_undegraded":"2024-09-10T21:07:09.982138+0000","last_fullsized":"2024-09-10T21:07:09.982138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.956032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.985729+0000","last_change":"2024-09-10T21:07:08.982133+0000","last_active":"2024-09-10T21:07:08.985729+0000","last_peered":"2024-09-10T21:07:08.985729+0000","last_clean":"2024-09-10T21:07:08.985729+0000","last_became_active":"2024-09-10T21:07:08.981870+0000","last_became_peered":"2024-09-10T21:07:08.981870+0000","last_unstale":"2024-09-10T21:07:08.985729+0000","last_undegraded":"2024-09-10T21:07:08.985729+0000","last_fullsized":"2024-09-10T21:07:08.985729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.978790+0000","last_change":"2024-09-10T21:07:07.980009+0000","last_active":"2024-09-10T21:07:08.978790+0000","last_peered":"2024-09-10T21:07:08.978790+0000","last_clean":"2024-09-10T21:07:08.978790+0000","last_became_active":"2024-09-10T21:07:07.979733+0000","last_became_peered":"2024-09-10T21:07:07.979733+0000","last_unstale":"2024-09-10T21:07:08.978790+0000","last_undegraded":"2024-09-10T21:07:08.978790+0000","last_fullsized":"2024-09-10T21:07:08.978790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:34.698327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.001980+0000","last_change":"2024-09-10T21:07:08.986736+0000","last_active":"2024-09-10T21:07:09.001980+0000","last_peered":"2024-09-10T21:07:09.001980+0000","last_clean":"2024-09-10T21:07:09.001980+0000","last_became_active":"2024-09-10T21:07:08.986446+0000","last_became_peered":"2024-09-10T21:07:08.986446+0000","last_unstale":"2024-09-10T21:07:09.001980+0000","last_undegraded":"2024-09-10T21:07:09.001980+0000","last_fullsized":"2024-09-10T21:07:09.001980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:35.371632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.970689+0000","last_change":"2024-09-10T21:07:07.976156+0000","last_active":"2024-09-10T21:07:08.970689+0000","last_peered":"2024-09-10T21:07:08.970689+0000","last_clean":"2024-09-10T21:07:08.970689+0000","last_became_active":"2024-09-10T21:07:07.975900+0000","last_became_peered":"2024-09-10T21:07:07.975900+0000","last_unstale":"2024-09-10T21:07:08.970689+0000","last_undegraded":"2024-09-10T21:07:08.970689+0000","last_fullsized":"2024-09-10T21:07:08.970689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:58.074407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.010629+0000","last_change":"2024-09-10T21:07:09.002670+0000","last_active":"2024-09-10T21:07:09.010629+0000","last_peered":"2024-09-10T21:07:09.010629+0000","last_clean":"2024-09-10T21:07:09.010629+0000","last_became_active":"2024-09-10T21:07:09.002402+0000","last_became_peered":"2024-09-10T21:07:09.002402+0000","last_unstale":"2024-09-10T21:07:09.010629+0000","last_undegraded":"2024-09-10T21:07:09.010629+0000","last_fullsized":"2024-09-10T21:07:09.010629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:37.617366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.010961+0000","last_change":"2024-09-10T21:07:07.980159+0000","last_active":"2024-09-10T21:07:09.010961+0000","last_peered":"2024-09-10T21:07:09.010961+0000","last_clean":"2024-09-10T21:07:09.010961+0000","last_became_active":"2024-09-10T21:07:07.977260+0000","last_became_peered":"2024-09-10T21:07:07.977260+0000","last_unstale":"2024-09-10T21:07:09.010961+0000","last_undegraded":"2024-09-10T21:07:09.010961+0000","last_fullsized":"2024-09-10T21:07:09.010961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:02.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982844+0000","last_change":"2024-09-10T21:07:08.992058+0000","last_active":"2024-09-10T21:07:09.982844+0000","last_peered":"2024-09-10T21:07:09.982844+0000","last_clean":"2024-09-10T21:07:09.982844+0000","last_became_active":"2024-09-10T21:07:08.991804+0000","last_became_peered":"2024-09-10T21:07:08.991804+0000","last_unstale":"2024-09-10T21:07:09.982844+0000","last_undegraded":"2024-09-10T21:07:09.982844+0000","last_fullsized":"2024-09-10T21:07:09.982844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.014061+0000","last_change":"2024-09-10T21:07:07.979647+0000","last_active":"2024-09-10T21:07:09.014061+0000","last_peered":"2024-09-10T21:07:09.014061+0000","last_clean":"2024-09-10T21:07:09.014061+0000","last_became_active":"2024-09-10T21:07:07.979160+0000","last_became_peered":"2024-09-10T21:07:07.979160+0000","last_unstale":"2024-09-10T21:07:09.014061+0000","last_undegraded":"2024-09-10T21:07:09.014061+0000","last_fullsized":"2024-09-10T21:07:09.014061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:57.596670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.988404+0000","last_change":"2024-09-10T21:07:08.984593+0000","last_active":"2024-09-10T21:07:08.988404+0000","last_peered":"2024-09-10T21:07:08.988404+0000","last_clean":"2024-09-10T21:07:08.988404+0000","last_became_active":"2024-09-10T21:07:08.983212+0000","last_became_peered":"2024-09-10T21:07:08.983212+0000","last_unstale":"2024-09-10T21:07:08.988404+0000","last_undegraded":"2024-09-10T21:07:08.988404+0000","last_fullsized":"2024-09-10T21:07:08.988404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006343+0000","last_change":"2024-09-10T21:07:07.975372+0000","last_active":"2024-09-10T21:07:09.006343+0000","last_peered":"2024-09-10T21:07:09.006343+0000","last_clean":"2024-09-10T21:07:09.006343+0000","last_became_active":"2024-09-10T21:07:07.972536+0000","last_became_peered":"2024-09-10T21:07:07.972536+0000","last_unstale":"2024-09-10T21:07:09.006343+0000","last_undegraded":"2024-09-10T21:07:09.006343+0000","last_fullsized":"2024-09-10T21:07:09.006343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982321+0000","last_change":"2024-09-10T21:07:08.996216+0000","last_active":"2024-09-10T21:07:09.982321+0000","last_peered":"2024-09-10T21:07:09.982321+0000","last_clean":"2024-09-10T21:07:09.982321+0000","last_became_active":"2024-09-10T21:07:08.995845+0000","last_became_peered":"2024-09-10T21:07:08.995845+0000","last_unstale":"2024-09-10T21:07:09.982321+0000","last_undegraded":"2024-09-10T21:07:09.982321+0000","last_fullsized":"2024-09-10T21:07:09.982321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:08.782273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981739+0000","last_change":"2024-09-10T21:07:07.974580+0000","last_active":"2024-09-10T21:07:09.981739+0000","last_peered":"2024-09-10T21:07:09.981739+0000","last_clean":"2024-09-10T21:07:09.981739+0000","last_became_active":"2024-09-10T21:07:07.974287+0000","last_became_peered":"2024-09-10T21:07:07.974287+0000","last_unstale":"2024-09-10T21:07:09.981739+0000","last_undegraded":"2024-09-10T21:07:09.981739+0000","last_fullsized":"2024-09-10T21:07:09.981739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:43.257928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988494+0000","last_change":"2024-09-10T21:07:08.990713+0000","last_active":"2024-09-10T21:07:09.988494+0000","last_peered":"2024-09-10T21:07:09.988494+0000","last_clean":"2024-09-10T21:07:09.988494+0000","last_became_active":"2024-09-10T21:07:08.990447+0000","last_became_peered":"2024-09-10T21:07:08.990447+0000","last_unstale":"2024-09-10T21:07:09.988494+0000","last_undegraded":"2024-09-10T21:07:09.988494+0000","last_fullsized":"2024-09-10T21:07:09.988494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.969223+0000","last_change":"2024-09-10T21:07:07.982710+0000","last_active":"2024-09-10T21:07:08.969223+0000","last_peered":"2024-09-10T21:07:08.969223+0000","last_clean":"2024-09-10T21:07:08.969223+0000","last_became_active":"2024-09-10T21:07:07.982189+0000","last_became_peered":"2024-09-10T21:07:07.982189+0000","last_unstale":"2024-09-10T21:07:08.969223+0000","last_undegraded":"2024-09-10T21:07:08.969223+0000","last_fullsized":"2024-09-10T21:07:08.969223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:21.481889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983543+0000","last_change":"2024-09-10T21:07:09.003185+0000","last_active":"2024-09-10T21:07:09.983543+0000","last_peered":"2024-09-10T21:07:09.983543+0000","last_clean":"2024-09-10T21:07:09.983543+0000","last_became_active":"2024-09-10T21:07:09.002210+0000","last_became_peered":"2024-09-10T21:07:09.002210+0000","last_unstale":"2024-09-10T21:07:09.983543+0000","last_undegraded":"2024-09-10T21:07:09.983543+0000","last_fullsized":"2024-09-10T21:07:09.983543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.014308+0000","last_change":"2024-09-10T21:07:07.977268+0000","last_active":"2024-09-10T21:07:09.014308+0000","last_peered":"2024-09-10T21:07:09.014308+0000","last_clean":"2024-09-10T21:07:09.014308+0000","last_became_active":"2024-09-10T21:07:07.977016+0000","last_became_peered":"2024-09-10T21:07:07.977016+0000","last_unstale":"2024-09-10T21:07:09.014308+0000","last_undegraded":"2024-09-10T21:07:09.014308+0000","last_fullsized":"2024-09-10T21:07:09.014308+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982259+0000","last_change":"2024-09-10T21:07:08.996569+0000","last_active":"2024-09-10T21:07:09.982259+0000","last_peered":"2024-09-10T21:07:09.982259+0000","last_clean":"2024-09-10T21:07:09.982259+0000","last_became_active":"2024-09-10T21:07:08.996285+0000","last_became_peered":"2024-09-10T21:07:08.996285+0000","last_unstale":"2024-09-10T21:07:09.982259+0000","last_undegraded":"2024-09-10T21:07:09.982259+0000","last_fullsized":"2024-09-10T21:07:09.982259+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:35.706362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982755+0000","last_change":"2024-09-10T21:07:07.975307+0000","last_active":"2024-09-10T21:07:09.982755+0000","last_peered":"2024-09-10T21:07:09.982755+0000","last_clean":"2024-09-10T21:07:09.982755+0000","last_became_active":"2024-09-10T21:07:07.975034+0000","last_became_peered":"2024-09-10T21:07:07.975034+0000","last_unstale":"2024-09-10T21:07:09.982755+0000","last_undegraded":"2024-09-10T21:07:09.982755+0000","last_fullsized":"2024-09-10T21:07:09.982755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:59.494549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982671+0000","last_change":"2024-09-10T21:07:08.987536+0000","last_active":"2024-09-10T21:07:09.982671+0000","last_peered":"2024-09-10T21:07:09.982671+0000","last_clean":"2024-09-10T21:07:09.982671+0000","last_became_active":"2024-09-10T21:07:08.987218+0000","last_became_peered":"2024-09-10T21:07:08.987218+0000","last_unstale":"2024-09-10T21:07:09.982671+0000","last_undegraded":"2024-09-10T21:07:09.982671+0000","last_fullsized":"2024-09-10T21:07:09.982671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009907+0000","last_change":"2024-09-10T21:07:07.975529+0000","last_active":"2024-09-10T21:07:09.009907+0000","last_peered":"2024-09-10T21:07:09.009907+0000","last_clean":"2024-09-10T21:07:09.009907+0000","last_became_active":"2024-09-10T21:07:07.974601+0000","last_became_peered":"2024-09-10T21:07:07.974601+0000","last_unstale":"2024-09-10T21:07:09.009907+0000","last_undegraded":"2024-09-10T21:07:09.009907+0000","last_fullsized":"2024-09-10T21:07:09.009907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:15.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982837+0000","last_change":"2024-09-10T21:07:08.994668+0000","last_active":"2024-09-10T21:07:09.982837+0000","last_peered":"2024-09-10T21:07:09.982837+0000","last_clean":"2024-09-10T21:07:09.982837+0000","last_became_active":"2024-09-10T21:07:08.994384+0000","last_became_peered":"2024-09-10T21:07:08.994384+0000","last_unstale":"2024-09-10T21:07:09.982837+0000","last_undegraded":"2024-09-10T21:07:09.982837+0000","last_fullsized":"2024-09-10T21:07:09.982837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:14.061765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983445+0000","last_change":"2024-09-10T21:07:07.984389+0000","last_active":"2024-09-10T21:07:09.983445+0000","last_peered":"2024-09-10T21:07:09.983445+0000","last_clean":"2024-09-10T21:07:09.983445+0000","last_became_active":"2024-09-10T21:07:07.983958+0000","last_became_peered":"2024-09-10T21:07:07.983958+0000","last_unstale":"2024-09-10T21:07:09.983445+0000","last_undegraded":"2024-09-10T21:07:09.983445+0000","last_fullsized":"2024-09-10T21:07:09.983445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:38.916517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-10T21:07:06.963205+0000","last_change":"2024-09-10T21:07:06.963205+0000","last_active":"2024-09-10T21:07:06.943662+0000","last_peered":"2024-09-10T21:07:06.943662+0000","last_clean":"2024-09-10T21:07:06.943662+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:06.963205+0000","last_undegraded":"2024-09-10T21:07:06.963205+0000","last_fullsized":"2024-09-10T21:07:06.963205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991928+0000","last_change":"2024-09-10T21:07:08.985488+0000","last_active":"2024-09-10T21:07:08.991928+0000","last_peered":"2024-09-10T21:07:08.991928+0000","last_clean":"2024-09-10T21:07:08.991928+0000","last_became_active":"2024-09-10T21:07:08.985240+0000","last_became_peered":"2024-09-10T21:07:08.985240+0000","last_unstale":"2024-09-10T21:07:08.991928+0000","last_undegraded":"2024-09-10T21:07:08.991928+0000","last_fullsized":"2024-09-10T21:07:08.991928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:21.219197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-10T21:07:06.963180+0000","last_change":"2024-09-10T21:07:06.963180+0000","last_active":"2024-09-10T21:07:06.943662+0000","last_peered":"2024-09-10T21:07:06.943662+0000","last_clean":"2024-09-10T21:07:06.943662+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:06.963180+0000","last_undegraded":"2024-09-10T21:07:06.963180+0000","last_fullsized":"2024-09-10T21:07:06.963180+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006712+0000","last_change":"2024-09-10T21:07:08.994822+0000","last_active":"2024-09-10T21:07:09.006712+0000","last_peered":"2024-09-10T21:07:09.006712+0000","last_clean":"2024-09-10T21:07:09.006712+0000","last_became_active":"2024-09-10T21:07:08.994580+0000","last_became_peered":"2024-09-10T21:07:08.994580+0000","last_unstale":"2024-09-10T21:07:09.006712+0000","last_undegraded":"2024-09-10T21:07:09.006712+0000","last_fullsized":"2024-09-10T21:07:09.006712+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981844+0000","last_change":"2024-09-10T21:07:07.970920+0000","last_active":"2024-09-10T21:07:09.981844+0000","last_peered":"2024-09-10T21:07:09.981844+0000","last_clean":"2024-09-10T21:07:09.981844+0000","last_became_active":"2024-09-10T21:07:07.970301+0000","last_became_peered":"2024-09-10T21:07:07.970301+0000","last_unstale":"2024-09-10T21:07:09.981844+0000","last_undegraded":"2024-09-10T21:07:09.981844+0000","last_fullsized":"2024-09-10T21:07:09.981844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988171+0000","last_change":"2024-09-10T21:07:08.990744+0000","last_active":"2024-09-10T21:07:09.988171+0000","last_peered":"2024-09-10T21:07:09.988171+0000","last_clean":"2024-09-10T21:07:09.988171+0000","last_became_active":"2024-09-10T21:07:08.989163+0000","last_became_peered":"2024-09-10T21:07:08.989163+0000","last_unstale":"2024-09-10T21:07:09.988171+0000","last_undegraded":"2024-09-10T21:07:09.988171+0000","last_fullsized":"2024-09-10T21:07:09.988171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982544+0000","last_change":"2024-09-10T21:07:07.974215+0000","last_active":"2024-09-10T21:07:09.982544+0000","last_peered":"2024-09-10T21:07:09.982544+0000","last_clean":"2024-09-10T21:07:09.982544+0000","last_became_active":"2024-09-10T21:07:07.973960+0000","last_became_peered":"2024-09-10T21:07:07.973960+0000","last_unstale":"2024-09-10T21:07:09.982544+0000","last_undegraded":"2024-09-10T21:07:09.982544+0000","last_fullsized":"2024-09-10T21:07:09.982544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.040936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009159+0000","last_change":"2024-09-10T21:07:09.004117+0000","last_active":"2024-09-10T21:07:09.009159+0000","last_peered":"2024-09-10T21:07:09.009159+0000","last_clean":"2024-09-10T21:07:09.009159+0000","last_became_active":"2024-09-10T21:07:09.003435+0000","last_became_peered":"2024-09-10T21:07:09.003435+0000","last_unstale":"2024-09-10T21:07:09.009159+0000","last_undegraded":"2024-09-10T21:07:09.009159+0000","last_fullsized":"2024-09-10T21:07:09.009159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981579+0000","last_change":"2024-09-10T21:07:07.975653+0000","last_active":"2024-09-10T21:07:09.981579+0000","last_peered":"2024-09-10T21:07:09.981579+0000","last_clean":"2024-09-10T21:07:09.981579+0000","last_became_active":"2024-09-10T21:07:07.975383+0000","last_became_peered":"2024-09-10T21:07:07.975383+0000","last_unstale":"2024-09-10T21:07:09.981579+0000","last_undegraded":"2024-09-10T21:07:09.981579+0000","last_fullsized":"2024-09-10T21:07:09.981579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:24.484277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983577+0000","last_change":"2024-09-10T21:07:09.003571+0000","last_active":"2024-09-10T21:07:09.983577+0000","last_peered":"2024-09-10T21:07:09.983577+0000","last_clean":"2024-09-10T21:07:09.983577+0000","last_became_active":"2024-09-10T21:07:09.003282+0000","last_became_peered":"2024-09-10T21:07:09.003282+0000","last_unstale":"2024-09-10T21:07:09.983577+0000","last_undegraded":"2024-09-10T21:07:09.983577+0000","last_fullsized":"2024-09-10T21:07:09.983577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.004958+0000","last_change":"2024-09-10T21:07:07.982369+0000","last_active":"2024-09-10T21:07:09.004958+0000","last_peered":"2024-09-10T21:07:09.004958+0000","last_clean":"2024-09-10T21:07:09.004958+0000","last_became_active":"2024-09-10T21:07:07.982077+0000","last_became_peered":"2024-09-10T21:07:07.982077+0000","last_unstale":"2024-09-10T21:07:09.004958+0000","last_undegraded":"2024-09-10T21:07:09.004958+0000","last_fullsized":"2024-09-10T21:07:09.004958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:40.539770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988694+0000","last_change":"2024-09-10T21:07:08.989455+0000","last_active":"2024-09-10T21:07:09.988694+0000","last_peered":"2024-09-10T21:07:09.988694+0000","last_clean":"2024-09-10T21:07:09.988694+0000","last_became_active":"2024-09-10T21:07:08.989206+0000","last_became_peered":"2024-09-10T21:07:08.989206+0000","last_unstale":"2024-09-10T21:07:09.988694+0000","last_undegraded":"2024-09-10T21:07:09.988694+0000","last_fullsized":"2024-09-10T21:07:09.988694+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.987453+0000","last_change":"2024-09-10T21:07:07.984174+0000","last_active":"2024-09-10T21:07:09.987453+0000","last_peered":"2024-09-10T21:07:09.987453+0000","last_clean":"2024-09-10T21:07:09.987453+0000","last_became_active":"2024-09-10T21:07:07.983898+0000","last_became_peered":"2024-09-10T21:07:07.983898+0000","last_unstale":"2024-09-10T21:07:09.987453+0000","last_undegraded":"2024-09-10T21:07:09.987453+0000","last_fullsized":"2024-09-10T21:07:09.987453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983503+0000","last_change":"2024-09-10T21:07:07.982520+0000","last_active":"2024-09-10T21:07:09.983503+0000","last_peered":"2024-09-10T21:07:09.983503+0000","last_clean":"2024-09-10T21:07:09.983503+0000","last_became_active":"2024-09-10T21:07:07.982215+0000","last_became_peered":"2024-09-10T21:07:07.982215+0000","last_unstale":"2024-09-10T21:07:09.983503+0000","last_undegraded":"2024-09-10T21:07:09.983503+0000","last_fullsized":"2024-09-10T21:07:09.983503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:38.024808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982590+0000","last_change":"2024-09-10T21:07:09.000771+0000","last_active":"2024-09-10T21:07:09.982590+0000","last_peered":"2024-09-10T21:07:09.982590+0000","last_clean":"2024-09-10T21:07:09.982590+0000","last_became_active":"2024-09-10T21:07:09.000225+0000","last_became_peered":"2024-09-10T21:07:09.000225+0000","last_unstale":"2024-09-10T21:07:09.982590+0000","last_undegraded":"2024-09-10T21:07:09.982590+0000","last_fullsized":"2024-09-10T21:07:09.982590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.975892+0000","last_change":"2024-09-10T21:07:07.972550+0000","last_active":"2024-09-10T21:07:08.975892+0000","last_peered":"2024-09-10T21:07:08.975892+0000","last_clean":"2024-09-10T21:07:08.975892+0000","last_became_active":"2024-09-10T21:07:07.972258+0000","last_became_peered":"2024-09-10T21:07:07.972258+0000","last_unstale":"2024-09-10T21:07:08.975892+0000","last_undegraded":"2024-09-10T21:07:08.975892+0000","last_fullsized":"2024-09-10T21:07:08.975892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:54.175968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981812+0000","last_change":"2024-09-10T21:07:08.993085+0000","last_active":"2024-09-10T21:07:09.981812+0000","last_peered":"2024-09-10T21:07:09.981812+0000","last_clean":"2024-09-10T21:07:09.981812+0000","last_became_active":"2024-09-10T21:07:08.992693+0000","last_became_peered":"2024-09-10T21:07:08.992693+0000","last_unstale":"2024-09-10T21:07:09.981812+0000","last_undegraded":"2024-09-10T21:07:09.981812+0000","last_fullsized":"2024-09-10T21:07:09.981812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:29.416774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988406+0000","last_change":"2024-09-10T21:07:07.984281+0000","last_active":"2024-09-10T21:07:09.988406+0000","last_peered":"2024-09-10T21:07:09.988406+0000","last_clean":"2024-09-10T21:07:09.988406+0000","last_became_active":"2024-09-10T21:07:07.983954+0000","last_became_peered":"2024-09-10T21:07:07.983954+0000","last_unstale":"2024-09-10T21:07:09.988406+0000","last_undegraded":"2024-09-10T21:07:09.988406+0000","last_fullsized":"2024-09-10T21:07:09.988406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:15.341376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.989535+0000","last_change":"2024-09-10T21:07:08.982222+0000","last_active":"2024-09-10T21:07:08.989535+0000","last_peered":"2024-09-10T21:07:08.989535+0000","last_clean":"2024-09-10T21:07:08.989535+0000","last_became_active":"2024-09-10T21:07:08.981942+0000","last_became_peered":"2024-09-10T21:07:08.981942+0000","last_unstale":"2024-09-10T21:07:08.989535+0000","last_undegraded":"2024-09-10T21:07:08.989535+0000","last_fullsized":"2024-09-10T21:07:08.989535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:18.777246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.969247+0000","last_change":"2024-09-10T21:07:07.982359+0000","last_active":"2024-09-10T21:07:08.969247+0000","last_peered":"2024-09-10T21:07:08.969247+0000","last_clean":"2024-09-10T21:07:08.969247+0000","last_became_active":"2024-09-10T21:07:07.982087+0000","last_became_peered":"2024-09-10T21:07:07.982087+0000","last_unstale":"2024-09-10T21:07:08.969247+0000","last_undegraded":"2024-09-10T21:07:08.969247+0000","last_fullsized":"2024-09-10T21:07:08.969247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:44.164885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988331+0000","last_change":"2024-09-10T21:07:08.994477+0000","last_active":"2024-09-10T21:07:09.988331+0000","last_peered":"2024-09-10T21:07:09.988331+0000","last_clean":"2024-09-10T21:07:09.988331+0000","last_became_active":"2024-09-10T21:07:08.994228+0000","last_became_peered":"2024-09-10T21:07:08.994228+0000","last_unstale":"2024-09-10T21:07:09.988331+0000","last_undegraded":"2024-09-10T21:07:09.988331+0000","last_fullsized":"2024-09-10T21:07:09.988331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.972673+0000","last_change":"2024-09-10T21:07:07.977266+0000","last_active":"2024-09-10T21:07:08.972673+0000","last_peered":"2024-09-10T21:07:08.972673+0000","last_clean":"2024-09-10T21:07:08.972673+0000","last_became_active":"2024-09-10T21:07:07.976927+0000","last_became_peered":"2024-09-10T21:07:07.976927+0000","last_unstale":"2024-09-10T21:07:08.972673+0000","last_undegraded":"2024-09-10T21:07:08.972673+0000","last_fullsized":"2024-09-10T21:07:08.972673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:04.086693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.001054+0000","last_change":"2024-09-10T21:07:08.996299+0000","last_active":"2024-09-10T21:07:09.001054+0000","last_peered":"2024-09-10T21:07:09.001054+0000","last_clean":"2024-09-10T21:07:09.001054+0000","last_became_active":"2024-09-10T21:07:08.995907+0000","last_became_peered":"2024-09-10T21:07:08.995907+0000","last_unstale":"2024-09-10T21:07:09.001054+0000","last_undegraded":"2024-09-10T21:07:09.001054+0000","last_fullsized":"2024-09-10T21:07:09.001054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:37.059713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988421+0000","last_change":"2024-09-10T21:07:07.979476+0000","last_active":"2024-09-10T21:07:09.988421+0000","last_peered":"2024-09-10T21:07:09.988421+0000","last_clean":"2024-09-10T21:07:09.988421+0000","last_became_active":"2024-09-10T21:07:07.979192+0000","last_became_peered":"2024-09-10T21:07:07.979192+0000","last_unstale":"2024-09-10T21:07:09.988421+0000","last_undegraded":"2024-09-10T21:07:09.988421+0000","last_fullsized":"2024-09-10T21:07:09.988421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:25.005206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982211+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:09.982211+0000","last_peered":"2024-09-10T21:07:09.982211+0000","last_clean":"2024-09-10T21:07:09.982211+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:09.982211+0000","last_undegraded":"2024-09-10T21:07:09.982211+0000","last_fullsized":"2024-09-10T21:07:09.982211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":195285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":193639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":195743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1064960,"data_stored":790631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":770083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:13.191 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.380+0000 7f3223200640 1 -- 172.21.15.100:0/948034760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c15b970 msgr2=0x7f321c071ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.380+0000 7f3223200640 1 --2- 172.21.15.100:0/948034760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c15b970 0x7f321c071ec0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3210005fd0 tx=0x7f321002a5f0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.380+0000 7f3223200640 1 -- 172.21.15.100:0/948034760 shutdown_connections 2024-09-10T21:07:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.380+0000 7f3223200640 1 --2- 172.21.15.100:0/948034760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c15b970 0x7f321c071ec0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.380+0000 7f3223200640 1 -- 172.21.15.100:0/948034760 >> 172.21.15.100:0/948034760 conn(0x7f321c09a9e0 msgr2=0x7f321c09adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.380+0000 7f3223200640 1 -- 172.21.15.100:0/948034760 shutdown_connections 2024-09-10T21:07:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.380+0000 7f3223200640 1 -- 172.21.15.100:0/948034760 wait complete. 2024-09-10T21:07:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.381+0000 7f3223200640 1 Processor -- start 2024-09-10T21:07:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.382+0000 7f3223200640 1 -- start start 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.382+0000 7f3223200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c0cfdf0 0x7f321c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.382+0000 7f3223200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c0d1cd0 0x7f321c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3223200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f321c15b970 0x7f321c1f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3223200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f321c0b0840 con 0x7f321c0cfdf0 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3223200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f321c0b06c0 con 0x7f321c0d1cd0 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3223200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f321c0b09c0 con 0x7f321c15b970 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c0cfdf0 0x7f321c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c0cfdf0 0x7f321c0c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32906/0 (socket says 172.21.15.100:32906) 2024-09-10T21:07:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221e00640 1 -- 172.21.15.100:0/4231041993 learned_addr learned my addr 172.21.15.100:0/4231041993 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221400640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c0d1cd0 0x7f321c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3222800640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f321c15b970 0x7f321c1f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221e00640 1 -- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f321c15b970 msgr2=0x7f321c1f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221e00640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f321c15b970 0x7f321c1f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221e00640 1 -- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c0d1cd0 msgr2=0x7f321c06e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221e00640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c0d1cd0 0x7f321c06e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.383+0000 7f3221e00640 1 -- 172.21.15.100:0/4231041993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c0cebe0 con 0x7f321c0cfdf0 2024-09-10T21:07:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.384+0000 7f3221e00640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c0cfdf0 0x7f321c0c7620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3210034040 tx=0x7f32100039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.384+0000 7f3216000640 1 -- 172.21.15.100:0/4231041993 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321003e030 con 0x7f321c0cfdf0 2024-09-10T21:07:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.384+0000 7f3216000640 1 -- 172.21.15.100:0/4231041993 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32100047a0 con 0x7f321c0cfdf0 2024-09-10T21:07:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.384+0000 7f3216000640 1 -- 172.21.15.100:0/4231041993 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210035040 con 0x7f321c0cfdf0 2024-09-10T21:07:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.384+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321c0ce060 con 0x7f321c0cfdf0 2024-09-10T21:07:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.384+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321c0ce620 con 0x7f321c0cfdf0 2024-09-10T21:07:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.385+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321c071ec0 con 0x7f321c0cfdf0 2024-09-10T21:07:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.386+0000 7f3216000640 1 -- 172.21.15.100:0/4231041993 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3210004b90 con 0x7f321c0cfdf0 2024-09-10T21:07:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.387+0000 7f3216000640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3200077f70 0x7f320007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.387+0000 7f3216000640 1 -- 172.21.15.100:0/4231041993 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f32100ba9c0 con 0x7f321c0cfdf0 2024-09-10T21:07:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.388+0000 7f3221400640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3200077f70 0x7f320007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.388+0000 7f3221400640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3200077f70 0x7f320007a430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f321c06fe40 tx=0x7f320c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.391+0000 7f3216000640 1 -- 172.21.15.100:0/4231041993 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3210082bb0 con 0x7f321c0cfdf0 2024-09-10T21:07:13.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.576+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f321c15a0a0 con 0x7f3200077f70 2024-09-10T21:07:13.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.581+0000 7f3216000640 1 -- 172.21.15.100:0/4231041993 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251208 (secure 0 0 0) 0x7f321c15a0a0 con 0x7f3200077f70 2024-09-10T21:07:13.589 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:13.590 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.585+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3200077f70 msgr2=0x7f320007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.585+0000 7f3223200640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3200077f70 0x7f320007a430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f321c06fe40 tx=0x7f320c009040 comp rx=0 tx=0).stop 2024-09-10T21:07:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.585+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c0cfdf0 msgr2=0x7f321c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.585+0000 7f3223200640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c0cfdf0 0x7f321c0c7620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3210034040 tx=0x7f32100039e0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.585+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 shutdown_connections 2024-09-10T21:07:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.585+0000 7f3223200640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f321c15b970 0x7f321c1f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.586+0000 7f3223200640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3200077f70 0x7f320007a430 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.586+0000 7f3223200640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f321c0d1cd0 0x7f321c06e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.586+0000 7f3223200640 1 --2- 172.21.15.100:0/4231041993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f321c0cfdf0 0x7f321c0c7620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.586+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 >> 172.21.15.100:0/4231041993 conn(0x7f321c09a9e0 msgr2=0x7f321c15a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.586+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 shutdown_connections 2024-09-10T21:07:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.586+0000 7f3223200640 1 -- 172.21.15.100:0/4231041993 wait complete. 2024-09-10T21:07:13.608 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-10T21:07:12.704101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221048,"kb_used_data":4796,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753672,"statfs":{"total":773094113280,"available":772867760128,"internally_reserved":0,"allocated":4911104,"data_stored":2746300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750773"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006398+0000","last_change":"2024-09-10T21:07:08.993655+0000","last_active":"2024-09-10T21:07:09.006398+0000","last_peered":"2024-09-10T21:07:09.006398+0000","last_clean":"2024-09-10T21:07:09.006398+0000","last_became_active":"2024-09-10T21:07:08.991972+0000","last_became_peered":"2024-09-10T21:07:08.991972+0000","last_unstale":"2024-09-10T21:07:09.006398+0000","last_undegraded":"2024-09-10T21:07:09.006398+0000","last_fullsized":"2024-09-10T21:07:09.006398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:42.045631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983097+0000","last_change":"2024-09-10T21:07:08.993612+0000","last_active":"2024-09-10T21:07:09.983097+0000","last_peered":"2024-09-10T21:07:09.983097+0000","last_clean":"2024-09-10T21:07:09.983097+0000","last_became_active":"2024-09-10T21:07:08.993291+0000","last_became_peered":"2024-09-10T21:07:08.993291+0000","last_unstale":"2024-09-10T21:07:09.983097+0000","last_undegraded":"2024-09-10T21:07:09.983097+0000","last_fullsized":"2024-09-10T21:07:09.983097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.998149+0000","last_change":"2024-09-10T21:07:08.986654+0000","last_active":"2024-09-10T21:07:08.998149+0000","last_peered":"2024-09-10T21:07:08.998149+0000","last_clean":"2024-09-10T21:07:08.998149+0000","last_became_active":"2024-09-10T21:07:08.986313+0000","last_became_peered":"2024-09-10T21:07:08.986313+0000","last_unstale":"2024-09-10T21:07:08.998149+0000","last_undegraded":"2024-09-10T21:07:08.998149+0000","last_fullsized":"2024-09-10T21:07:08.998149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.007251+0000","last_change":"2024-09-10T21:07:08.992089+0000","last_active":"2024-09-10T21:07:09.007251+0000","last_peered":"2024-09-10T21:07:09.007251+0000","last_clean":"2024-09-10T21:07:09.007251+0000","last_became_active":"2024-09-10T21:07:08.991795+0000","last_became_peered":"2024-09-10T21:07:08.991795+0000","last_unstale":"2024-09-10T21:07:09.007251+0000","last_undegraded":"2024-09-10T21:07:09.007251+0000","last_fullsized":"2024-09-10T21:07:09.007251+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983410+0000","last_change":"2024-09-10T21:07:09.006257+0000","last_active":"2024-09-10T21:07:09.983410+0000","last_peered":"2024-09-10T21:07:09.983410+0000","last_clean":"2024-09-10T21:07:09.983410+0000","last_became_active":"2024-09-10T21:07:09.005851+0000","last_became_peered":"2024-09-10T21:07:09.005851+0000","last_unstale":"2024-09-10T21:07:09.983410+0000","last_undegraded":"2024-09-10T21:07:09.983410+0000","last_fullsized":"2024-09-10T21:07:09.983410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981787+0000","last_change":"2024-09-10T21:07:08.985543+0000","last_active":"2024-09-10T21:07:09.981787+0000","last_peered":"2024-09-10T21:07:09.981787+0000","last_clean":"2024-09-10T21:07:09.981787+0000","last_became_active":"2024-09-10T21:07:08.981933+0000","last_became_peered":"2024-09-10T21:07:08.981933+0000","last_unstale":"2024-09-10T21:07:09.981787+0000","last_undegraded":"2024-09-10T21:07:09.981787+0000","last_fullsized":"2024-09-10T21:07:09.981787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:55.184003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982434+0000","last_change":"2024-09-10T21:07:08.991775+0000","last_active":"2024-09-10T21:07:09.982434+0000","last_peered":"2024-09-10T21:07:09.982434+0000","last_clean":"2024-09-10T21:07:09.982434+0000","last_became_active":"2024-09-10T21:07:08.991499+0000","last_became_peered":"2024-09-10T21:07:08.991499+0000","last_unstale":"2024-09-10T21:07:09.982434+0000","last_undegraded":"2024-09-10T21:07:09.982434+0000","last_fullsized":"2024-09-10T21:07:09.982434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008785+0000","last_change":"2024-09-10T21:07:09.003113+0000","last_active":"2024-09-10T21:07:09.008785+0000","last_peered":"2024-09-10T21:07:09.008785+0000","last_clean":"2024-09-10T21:07:09.008785+0000","last_became_active":"2024-09-10T21:07:09.002875+0000","last_became_peered":"2024-09-10T21:07:09.002875+0000","last_unstale":"2024-09-10T21:07:09.008785+0000","last_undegraded":"2024-09-10T21:07:09.008785+0000","last_fullsized":"2024-09-10T21:07:09.008785+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:25.364850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983824+0000","last_change":"2024-09-10T21:07:08.995695+0000","last_active":"2024-09-10T21:07:09.983824+0000","last_peered":"2024-09-10T21:07:09.983824+0000","last_clean":"2024-09-10T21:07:09.983824+0000","last_became_active":"2024-09-10T21:07:08.995450+0000","last_became_peered":"2024-09-10T21:07:08.995450+0000","last_unstale":"2024-09-10T21:07:09.983824+0000","last_undegraded":"2024-09-10T21:07:09.983824+0000","last_fullsized":"2024-09-10T21:07:09.983824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982683+0000","last_change":"2024-09-10T21:07:08.987778+0000","last_active":"2024-09-10T21:07:09.982683+0000","last_peered":"2024-09-10T21:07:09.982683+0000","last_clean":"2024-09-10T21:07:09.982683+0000","last_became_active":"2024-09-10T21:07:08.987558+0000","last_became_peered":"2024-09-10T21:07:08.987558+0000","last_unstale":"2024-09-10T21:07:09.982683+0000","last_undegraded":"2024-09-10T21:07:09.982683+0000","last_fullsized":"2024-09-10T21:07:09.982683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:26.013241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988586+0000","last_change":"2024-09-10T21:07:09.004347+0000","last_active":"2024-09-10T21:07:09.988586+0000","last_peered":"2024-09-10T21:07:09.988586+0000","last_clean":"2024-09-10T21:07:09.988586+0000","last_became_active":"2024-09-10T21:07:09.004076+0000","last_became_peered":"2024-09-10T21:07:09.004076+0000","last_unstale":"2024-09-10T21:07:09.988586+0000","last_undegraded":"2024-09-10T21:07:09.988586+0000","last_fullsized":"2024-09-10T21:07:09.988586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983673+0000","last_change":"2024-09-10T21:07:09.001468+0000","last_active":"2024-09-10T21:07:09.983673+0000","last_peered":"2024-09-10T21:07:09.983673+0000","last_clean":"2024-09-10T21:07:09.983673+0000","last_became_active":"2024-09-10T21:07:09.001207+0000","last_became_peered":"2024-09-10T21:07:09.001207+0000","last_unstale":"2024-09-10T21:07:09.983673+0000","last_undegraded":"2024-09-10T21:07:09.983673+0000","last_fullsized":"2024-09-10T21:07:09.983673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982349+0000","last_change":"2024-09-10T21:07:08.995284+0000","last_active":"2024-09-10T21:07:09.982349+0000","last_peered":"2024-09-10T21:07:09.982349+0000","last_clean":"2024-09-10T21:07:09.982349+0000","last_became_active":"2024-09-10T21:07:08.994529+0000","last_became_peered":"2024-09-10T21:07:08.994529+0000","last_unstale":"2024-09-10T21:07:09.982349+0000","last_undegraded":"2024-09-10T21:07:09.982349+0000","last_fullsized":"2024-09-10T21:07:09.982349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.002042+0000","last_change":"2024-09-10T21:07:08.988477+0000","last_active":"2024-09-10T21:07:09.002042+0000","last_peered":"2024-09-10T21:07:09.002042+0000","last_clean":"2024-09-10T21:07:09.002042+0000","last_became_active":"2024-09-10T21:07:08.988146+0000","last_became_peered":"2024-09-10T21:07:08.988146+0000","last_unstale":"2024-09-10T21:07:09.002042+0000","last_undegraded":"2024-09-10T21:07:09.002042+0000","last_fullsized":"2024-09-10T21:07:09.002042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:37.378222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.998634+0000","last_change":"2024-09-10T21:07:08.992983+0000","last_active":"2024-09-10T21:07:08.998634+0000","last_peered":"2024-09-10T21:07:08.998634+0000","last_clean":"2024-09-10T21:07:08.998634+0000","last_became_active":"2024-09-10T21:07:08.992683+0000","last_became_peered":"2024-09-10T21:07:08.992683+0000","last_unstale":"2024-09-10T21:07:08.998634+0000","last_undegraded":"2024-09-10T21:07:08.998634+0000","last_fullsized":"2024-09-10T21:07:08.998634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:35.716765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982205+0000","last_change":"2024-09-10T21:07:08.982108+0000","last_active":"2024-09-10T21:07:09.982205+0000","last_peered":"2024-09-10T21:07:09.982205+0000","last_clean":"2024-09-10T21:07:09.982205+0000","last_became_active":"2024-09-10T21:07:08.981887+0000","last_became_peered":"2024-09-10T21:07:08.981887+0000","last_unstale":"2024-09-10T21:07:09.982205+0000","last_undegraded":"2024-09-10T21:07:09.982205+0000","last_fullsized":"2024-09-10T21:07:09.982205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991780+0000","last_change":"2024-09-10T21:07:08.986295+0000","last_active":"2024-09-10T21:07:08.991780+0000","last_peered":"2024-09-10T21:07:08.991780+0000","last_clean":"2024-09-10T21:07:08.991780+0000","last_became_active":"2024-09-10T21:07:08.983589+0000","last_became_peered":"2024-09-10T21:07:08.983589+0000","last_unstale":"2024-09-10T21:07:08.991780+0000","last_undegraded":"2024-09-10T21:07:08.991780+0000","last_fullsized":"2024-09-10T21:07:08.991780+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:04.873265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991889+0000","last_change":"2024-09-10T21:07:08.987716+0000","last_active":"2024-09-10T21:07:08.991889+0000","last_peered":"2024-09-10T21:07:08.991889+0000","last_clean":"2024-09-10T21:07:08.991889+0000","last_became_active":"2024-09-10T21:07:08.986131+0000","last_became_peered":"2024-09-10T21:07:08.986131+0000","last_unstale":"2024-09-10T21:07:08.991889+0000","last_undegraded":"2024-09-10T21:07:08.991889+0000","last_fullsized":"2024-09-10T21:07:08.991889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:55.256639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988341+0000","last_change":"2024-09-10T21:07:08.989449+0000","last_active":"2024-09-10T21:07:09.988341+0000","last_peered":"2024-09-10T21:07:09.988341+0000","last_clean":"2024-09-10T21:07:09.988341+0000","last_became_active":"2024-09-10T21:07:08.988365+0000","last_became_peered":"2024-09-10T21:07:08.988365+0000","last_unstale":"2024-09-10T21:07:09.988341+0000","last_undegraded":"2024-09-10T21:07:09.988341+0000","last_fullsized":"2024-09-10T21:07:09.988341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:15.897184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988657+0000","last_change":"2024-09-10T21:07:08.984966+0000","last_active":"2024-09-10T21:07:09.988657+0000","last_peered":"2024-09-10T21:07:09.988657+0000","last_clean":"2024-09-10T21:07:09.988657+0000","last_became_active":"2024-09-10T21:07:08.984696+0000","last_became_peered":"2024-09-10T21:07:08.984696+0000","last_unstale":"2024-09-10T21:07:09.988657+0000","last_undegraded":"2024-09-10T21:07:09.988657+0000","last_fullsized":"2024-09-10T21:07:09.988657+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:48.470274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988163+0000","last_change":"2024-09-10T21:07:08.992572+0000","last_active":"2024-09-10T21:07:09.988163+0000","last_peered":"2024-09-10T21:07:09.988163+0000","last_clean":"2024-09-10T21:07:09.988163+0000","last_became_active":"2024-09-10T21:07:08.992231+0000","last_became_peered":"2024-09-10T21:07:08.992231+0000","last_unstale":"2024-09-10T21:07:09.988163+0000","last_undegraded":"2024-09-10T21:07:09.988163+0000","last_fullsized":"2024-09-10T21:07:09.988163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.996609+0000","last_change":"2024-09-10T21:07:08.990954+0000","last_active":"2024-09-10T21:07:08.996609+0000","last_peered":"2024-09-10T21:07:08.996609+0000","last_clean":"2024-09-10T21:07:08.996609+0000","last_became_active":"2024-09-10T21:07:08.989166+0000","last_became_peered":"2024-09-10T21:07:08.989166+0000","last_unstale":"2024-09-10T21:07:08.996609+0000","last_undegraded":"2024-09-10T21:07:08.996609+0000","last_fullsized":"2024-09-10T21:07:08.996609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:48.434984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008398+0000","last_change":"2024-09-10T21:07:08.998488+0000","last_active":"2024-09-10T21:07:09.008398+0000","last_peered":"2024-09-10T21:07:09.008398+0000","last_clean":"2024-09-10T21:07:09.008398+0000","last_became_active":"2024-09-10T21:07:08.997677+0000","last_became_peered":"2024-09-10T21:07:08.997677+0000","last_unstale":"2024-09-10T21:07:09.008398+0000","last_undegraded":"2024-09-10T21:07:09.008398+0000","last_fullsized":"2024-09-10T21:07:09.008398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:06:30.641657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008530+0000","last_change":"2024-09-10T21:07:09.003139+0000","last_active":"2024-09-10T21:07:09.008530+0000","last_peered":"2024-09-10T21:07:09.008530+0000","last_clean":"2024-09-10T21:07:09.008530+0000","last_became_active":"2024-09-10T21:07:09.002972+0000","last_became_peered":"2024-09-10T21:07:09.002972+0000","last_unstale":"2024-09-10T21:07:09.008530+0000","last_undegraded":"2024-09-10T21:07:09.008530+0000","last_fullsized":"2024-09-10T21:07:09.008530+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008454+0000","last_change":"2024-09-10T21:07:08.998658+0000","last_active":"2024-09-10T21:07:09.008454+0000","last_peered":"2024-09-10T21:07:09.008454+0000","last_clean":"2024-09-10T21:07:09.008454+0000","last_became_active":"2024-09-10T21:07:08.993838+0000","last_became_peered":"2024-09-10T21:07:08.993838+0000","last_unstale":"2024-09-10T21:07:09.008454+0000","last_undegraded":"2024-09-10T21:07:09.008454+0000","last_fullsized":"2024-09-10T21:07:09.008454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988654+0000","last_change":"2024-09-10T21:07:08.997383+0000","last_active":"2024-09-10T21:07:09.988654+0000","last_peered":"2024-09-10T21:07:09.988654+0000","last_clean":"2024-09-10T21:07:09.988654+0000","last_became_active":"2024-09-10T21:07:08.997089+0000","last_became_peered":"2024-09-10T21:07:08.997089+0000","last_unstale":"2024-09-10T21:07:09.988654+0000","last_undegraded":"2024-09-10T21:07:09.988654+0000","last_fullsized":"2024-09-10T21:07:09.988654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982632+0000","last_change":"2024-09-10T21:07:08.993822+0000","last_active":"2024-09-10T21:07:09.982632+0000","last_peered":"2024-09-10T21:07:09.982632+0000","last_clean":"2024-09-10T21:07:09.982632+0000","last_became_active":"2024-09-10T21:07:08.991716+0000","last_became_peered":"2024-09-10T21:07:08.991716+0000","last_unstale":"2024-09-10T21:07:09.982632+0000","last_undegraded":"2024-09-10T21:07:09.982632+0000","last_fullsized":"2024-09-10T21:07:09.982632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993244+0000","last_change":"2024-09-10T21:07:08.988982+0000","last_active":"2024-09-10T21:07:08.993244+0000","last_peered":"2024-09-10T21:07:08.993244+0000","last_clean":"2024-09-10T21:07:08.993244+0000","last_became_active":"2024-09-10T21:07:08.988654+0000","last_became_peered":"2024-09-10T21:07:08.988654+0000","last_unstale":"2024-09-10T21:07:08.993244+0000","last_undegraded":"2024-09-10T21:07:08.993244+0000","last_fullsized":"2024-09-10T21:07:08.993244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:46.803121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993168+0000","last_change":"2024-09-10T21:07:08.989788+0000","last_active":"2024-09-10T21:07:08.993168+0000","last_peered":"2024-09-10T21:07:08.993168+0000","last_clean":"2024-09-10T21:07:08.993168+0000","last_became_active":"2024-09-10T21:07:08.988825+0000","last_became_peered":"2024-09-10T21:07:08.988825+0000","last_unstale":"2024-09-10T21:07:08.993168+0000","last_undegraded":"2024-09-10T21:07:08.993168+0000","last_fullsized":"2024-09-10T21:07:08.993168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.855818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982533+0000","last_change":"2024-09-10T21:07:08.982659+0000","last_active":"2024-09-10T21:07:09.982533+0000","last_peered":"2024-09-10T21:07:09.982533+0000","last_clean":"2024-09-10T21:07:09.982533+0000","last_became_active":"2024-09-10T21:07:08.982365+0000","last_became_peered":"2024-09-10T21:07:08.982365+0000","last_unstale":"2024-09-10T21:07:09.982533+0000","last_undegraded":"2024-09-10T21:07:09.982533+0000","last_fullsized":"2024-09-10T21:07:09.982533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008381+0000","last_change":"2024-09-10T21:07:08.998256+0000","last_active":"2024-09-10T21:07:09.008381+0000","last_peered":"2024-09-10T21:07:09.008381+0000","last_clean":"2024-09-10T21:07:09.008381+0000","last_became_active":"2024-09-10T21:07:08.994815+0000","last_became_peered":"2024-09-10T21:07:08.994815+0000","last_unstale":"2024-09-10T21:07:09.008381+0000","last_undegraded":"2024-09-10T21:07:09.008381+0000","last_fullsized":"2024-09-10T21:07:09.008381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993127+0000","last_change":"2024-09-10T21:07:08.989239+0000","last_active":"2024-09-10T21:07:08.993127+0000","last_peered":"2024-09-10T21:07:08.993127+0000","last_clean":"2024-09-10T21:07:08.993127+0000","last_became_active":"2024-09-10T21:07:08.988990+0000","last_became_peered":"2024-09-10T21:07:08.988990+0000","last_unstale":"2024-09-10T21:07:08.993127+0000","last_undegraded":"2024-09-10T21:07:08.993127+0000","last_fullsized":"2024-09-10T21:07:08.993127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:06.536654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.013538+0000","last_change":"2024-09-10T21:07:07.982303+0000","last_active":"2024-09-10T21:07:09.013538+0000","last_peered":"2024-09-10T21:07:09.013538+0000","last_clean":"2024-09-10T21:07:09.013538+0000","last_became_active":"2024-09-10T21:07:07.982051+0000","last_became_peered":"2024-09-10T21:07:07.982051+0000","last_unstale":"2024-09-10T21:07:09.013538+0000","last_undegraded":"2024-09-10T21:07:09.013538+0000","last_fullsized":"2024-09-10T21:07:09.013538+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:36.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982710+0000","last_change":"2024-09-10T21:07:08.989864+0000","last_active":"2024-09-10T21:07:09.982710+0000","last_peered":"2024-09-10T21:07:09.982710+0000","last_clean":"2024-09-10T21:07:09.982710+0000","last_became_active":"2024-09-10T21:07:08.989615+0000","last_became_peered":"2024-09-10T21:07:08.989615+0000","last_unstale":"2024-09-10T21:07:09.982710+0000","last_undegraded":"2024-09-10T21:07:09.982710+0000","last_fullsized":"2024-09-10T21:07:09.982710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982909+0000","last_change":"2024-09-10T21:07:07.975121+0000","last_active":"2024-09-10T21:07:09.982909+0000","last_peered":"2024-09-10T21:07:09.982909+0000","last_clean":"2024-09-10T21:07:09.982909+0000","last_became_active":"2024-09-10T21:07:07.974854+0000","last_became_peered":"2024-09-10T21:07:07.974854+0000","last_unstale":"2024-09-10T21:07:09.982909+0000","last_undegraded":"2024-09-10T21:07:09.982909+0000","last_fullsized":"2024-09-10T21:07:09.982909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991864+0000","last_change":"2024-09-10T21:07:08.984081+0000","last_active":"2024-09-10T21:07:08.991864+0000","last_peered":"2024-09-10T21:07:08.991864+0000","last_clean":"2024-09-10T21:07:08.991864+0000","last_became_active":"2024-09-10T21:07:08.983081+0000","last_became_peered":"2024-09-10T21:07:08.983081+0000","last_unstale":"2024-09-10T21:07:08.991864+0000","last_undegraded":"2024-09-10T21:07:08.991864+0000","last_fullsized":"2024-09-10T21:07:08.991864+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:14.488707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006307+0000","last_change":"2024-09-10T21:07:07.974937+0000","last_active":"2024-09-10T21:07:09.006307+0000","last_peered":"2024-09-10T21:07:09.006307+0000","last_clean":"2024-09-10T21:07:09.006307+0000","last_became_active":"2024-09-10T21:07:07.973491+0000","last_became_peered":"2024-09-10T21:07:07.973491+0000","last_unstale":"2024-09-10T21:07:09.006307+0000","last_undegraded":"2024-09-10T21:07:09.006307+0000","last_fullsized":"2024-09-10T21:07:09.006307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:28.408739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982984+0000","last_change":"2024-09-10T21:07:08.989505+0000","last_active":"2024-09-10T21:07:09.982984+0000","last_peered":"2024-09-10T21:07:09.982984+0000","last_clean":"2024-09-10T21:07:09.982984+0000","last_became_active":"2024-09-10T21:07:08.988284+0000","last_became_peered":"2024-09-10T21:07:08.988284+0000","last_unstale":"2024-09-10T21:07:09.982984+0000","last_undegraded":"2024-09-10T21:07:09.982984+0000","last_fullsized":"2024-09-10T21:07:09.982984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009024+0000","last_change":"2024-09-10T21:07:07.983144+0000","last_active":"2024-09-10T21:07:09.009024+0000","last_peered":"2024-09-10T21:07:09.009024+0000","last_clean":"2024-09-10T21:07:09.009024+0000","last_became_active":"2024-09-10T21:07:07.982903+0000","last_became_peered":"2024-09-10T21:07:07.982903+0000","last_unstale":"2024-09-10T21:07:09.009024+0000","last_undegraded":"2024-09-10T21:07:09.009024+0000","last_fullsized":"2024-09-10T21:07:09.009024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008357+0000","last_change":"2024-09-10T21:07:08.997979+0000","last_active":"2024-09-10T21:07:09.008357+0000","last_peered":"2024-09-10T21:07:09.008357+0000","last_clean":"2024-09-10T21:07:09.008357+0000","last_became_active":"2024-09-10T21:07:08.994323+0000","last_became_peered":"2024-09-10T21:07:08.994323+0000","last_unstale":"2024-09-10T21:07:09.008357+0000","last_undegraded":"2024-09-10T21:07:09.008357+0000","last_fullsized":"2024-09-10T21:07:09.008357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.005693+0000","last_change":"2024-09-10T21:07:07.980708+0000","last_active":"2024-09-10T21:07:09.005693+0000","last_peered":"2024-09-10T21:07:09.005693+0000","last_clean":"2024-09-10T21:07:09.005693+0000","last_became_active":"2024-09-10T21:07:07.980440+0000","last_became_peered":"2024-09-10T21:07:07.980440+0000","last_unstale":"2024-09-10T21:07:09.005693+0000","last_undegraded":"2024-09-10T21:07:09.005693+0000","last_fullsized":"2024-09-10T21:07:09.005693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:25.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988142+0000","last_change":"2024-09-10T21:07:08.997562+0000","last_active":"2024-09-10T21:07:09.988142+0000","last_peered":"2024-09-10T21:07:09.988142+0000","last_clean":"2024-09-10T21:07:09.988142+0000","last_became_active":"2024-09-10T21:07:08.997293+0000","last_became_peered":"2024-09-10T21:07:08.997293+0000","last_unstale":"2024-09-10T21:07:09.988142+0000","last_undegraded":"2024-09-10T21:07:09.988142+0000","last_fullsized":"2024-09-10T21:07:09.988142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982325+0000","last_change":"2024-09-10T21:07:07.977927+0000","last_active":"2024-09-10T21:07:09.982325+0000","last_peered":"2024-09-10T21:07:09.982325+0000","last_clean":"2024-09-10T21:07:09.982325+0000","last_became_active":"2024-09-10T21:07:07.976343+0000","last_became_peered":"2024-09-10T21:07:07.976343+0000","last_unstale":"2024-09-10T21:07:09.982325+0000","last_undegraded":"2024-09-10T21:07:09.982325+0000","last_fullsized":"2024-09-10T21:07:09.982325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:13.035700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.984081+0000","last_change":"2024-09-10T21:07:08.981362+0000","last_active":"2024-09-10T21:07:08.984081+0000","last_peered":"2024-09-10T21:07:08.984081+0000","last_clean":"2024-09-10T21:07:08.984081+0000","last_became_active":"2024-09-10T21:07:08.981095+0000","last_became_peered":"2024-09-10T21:07:08.981095+0000","last_unstale":"2024-09-10T21:07:08.984081+0000","last_undegraded":"2024-09-10T21:07:08.984081+0000","last_fullsized":"2024-09-10T21:07:08.984081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:24.429348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.979079+0000","last_change":"2024-09-10T21:07:07.974482+0000","last_active":"2024-09-10T21:07:08.979079+0000","last_peered":"2024-09-10T21:07:08.979079+0000","last_clean":"2024-09-10T21:07:08.979079+0000","last_became_active":"2024-09-10T21:07:07.974215+0000","last_became_peered":"2024-09-10T21:07:07.974215+0000","last_unstale":"2024-09-10T21:07:08.979079+0000","last_undegraded":"2024-09-10T21:07:08.979079+0000","last_fullsized":"2024-09-10T21:07:08.979079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:07.774238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982188+0000","last_change":"2024-09-10T21:07:08.990378+0000","last_active":"2024-09-10T21:07:09.982188+0000","last_peered":"2024-09-10T21:07:09.982188+0000","last_clean":"2024-09-10T21:07:09.982188+0000","last_became_active":"2024-09-10T21:07:08.990072+0000","last_became_peered":"2024-09-10T21:07:08.990072+0000","last_unstale":"2024-09-10T21:07:09.982188+0000","last_undegraded":"2024-09-10T21:07:09.982188+0000","last_fullsized":"2024-09-10T21:07:09.982188+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:58.604705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982138+0000","last_change":"2024-09-10T21:07:07.975095+0000","last_active":"2024-09-10T21:07:09.982138+0000","last_peered":"2024-09-10T21:07:09.982138+0000","last_clean":"2024-09-10T21:07:09.982138+0000","last_became_active":"2024-09-10T21:07:07.974845+0000","last_became_peered":"2024-09-10T21:07:07.974845+0000","last_unstale":"2024-09-10T21:07:09.982138+0000","last_undegraded":"2024-09-10T21:07:09.982138+0000","last_fullsized":"2024-09-10T21:07:09.982138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.956032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.985729+0000","last_change":"2024-09-10T21:07:08.982133+0000","last_active":"2024-09-10T21:07:08.985729+0000","last_peered":"2024-09-10T21:07:08.985729+0000","last_clean":"2024-09-10T21:07:08.985729+0000","last_became_active":"2024-09-10T21:07:08.981870+0000","last_became_peered":"2024-09-10T21:07:08.981870+0000","last_unstale":"2024-09-10T21:07:08.985729+0000","last_undegraded":"2024-09-10T21:07:08.985729+0000","last_fullsized":"2024-09-10T21:07:08.985729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.978790+0000","last_change":"2024-09-10T21:07:07.980009+0000","last_active":"2024-09-10T21:07:08.978790+0000","last_peered":"2024-09-10T21:07:08.978790+0000","last_clean":"2024-09-10T21:07:08.978790+0000","last_became_active":"2024-09-10T21:07:07.979733+0000","last_became_peered":"2024-09-10T21:07:07.979733+0000","last_unstale":"2024-09-10T21:07:08.978790+0000","last_undegraded":"2024-09-10T21:07:08.978790+0000","last_fullsized":"2024-09-10T21:07:08.978790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:34.698327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.001980+0000","last_change":"2024-09-10T21:07:08.986736+0000","last_active":"2024-09-10T21:07:09.001980+0000","last_peered":"2024-09-10T21:07:09.001980+0000","last_clean":"2024-09-10T21:07:09.001980+0000","last_became_active":"2024-09-10T21:07:08.986446+0000","last_became_peered":"2024-09-10T21:07:08.986446+0000","last_unstale":"2024-09-10T21:07:09.001980+0000","last_undegraded":"2024-09-10T21:07:09.001980+0000","last_fullsized":"2024-09-10T21:07:09.001980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:35.371632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.970689+0000","last_change":"2024-09-10T21:07:07.976156+0000","last_active":"2024-09-10T21:07:08.970689+0000","last_peered":"2024-09-10T21:07:08.970689+0000","last_clean":"2024-09-10T21:07:08.970689+0000","last_became_active":"2024-09-10T21:07:07.975900+0000","last_became_peered":"2024-09-10T21:07:07.975900+0000","last_unstale":"2024-09-10T21:07:08.970689+0000","last_undegraded":"2024-09-10T21:07:08.970689+0000","last_fullsized":"2024-09-10T21:07:08.970689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:58.074407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.010629+0000","last_change":"2024-09-10T21:07:09.002670+0000","last_active":"2024-09-10T21:07:09.010629+0000","last_peered":"2024-09-10T21:07:09.010629+0000","last_clean":"2024-09-10T21:07:09.010629+0000","last_became_active":"2024-09-10T21:07:09.002402+0000","last_became_peered":"2024-09-10T21:07:09.002402+0000","last_unstale":"2024-09-10T21:07:09.010629+0000","last_undegraded":"2024-09-10T21:07:09.010629+0000","last_fullsized":"2024-09-10T21:07:09.010629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:37.617366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.010961+0000","last_change":"2024-09-10T21:07:07.980159+0000","last_active":"2024-09-10T21:07:09.010961+0000","last_peered":"2024-09-10T21:07:09.010961+0000","last_clean":"2024-09-10T21:07:09.010961+0000","last_became_active":"2024-09-10T21:07:07.977260+0000","last_became_peered":"2024-09-10T21:07:07.977260+0000","last_unstale":"2024-09-10T21:07:09.010961+0000","last_undegraded":"2024-09-10T21:07:09.010961+0000","last_fullsized":"2024-09-10T21:07:09.010961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:02.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982844+0000","last_change":"2024-09-10T21:07:08.992058+0000","last_active":"2024-09-10T21:07:09.982844+0000","last_peered":"2024-09-10T21:07:09.982844+0000","last_clean":"2024-09-10T21:07:09.982844+0000","last_became_active":"2024-09-10T21:07:08.991804+0000","last_became_peered":"2024-09-10T21:07:08.991804+0000","last_unstale":"2024-09-10T21:07:09.982844+0000","last_undegraded":"2024-09-10T21:07:09.982844+0000","last_fullsized":"2024-09-10T21:07:09.982844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.014061+0000","last_change":"2024-09-10T21:07:07.979647+0000","last_active":"2024-09-10T21:07:09.014061+0000","last_peered":"2024-09-10T21:07:09.014061+0000","last_clean":"2024-09-10T21:07:09.014061+0000","last_became_active":"2024-09-10T21:07:07.979160+0000","last_became_peered":"2024-09-10T21:07:07.979160+0000","last_unstale":"2024-09-10T21:07:09.014061+0000","last_undegraded":"2024-09-10T21:07:09.014061+0000","last_fullsized":"2024-09-10T21:07:09.014061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:57.596670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.988404+0000","last_change":"2024-09-10T21:07:08.984593+0000","last_active":"2024-09-10T21:07:08.988404+0000","last_peered":"2024-09-10T21:07:08.988404+0000","last_clean":"2024-09-10T21:07:08.988404+0000","last_became_active":"2024-09-10T21:07:08.983212+0000","last_became_peered":"2024-09-10T21:07:08.983212+0000","last_unstale":"2024-09-10T21:07:08.988404+0000","last_undegraded":"2024-09-10T21:07:08.988404+0000","last_fullsized":"2024-09-10T21:07:08.988404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006343+0000","last_change":"2024-09-10T21:07:07.975372+0000","last_active":"2024-09-10T21:07:09.006343+0000","last_peered":"2024-09-10T21:07:09.006343+0000","last_clean":"2024-09-10T21:07:09.006343+0000","last_became_active":"2024-09-10T21:07:07.972536+0000","last_became_peered":"2024-09-10T21:07:07.972536+0000","last_unstale":"2024-09-10T21:07:09.006343+0000","last_undegraded":"2024-09-10T21:07:09.006343+0000","last_fullsized":"2024-09-10T21:07:09.006343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982321+0000","last_change":"2024-09-10T21:07:08.996216+0000","last_active":"2024-09-10T21:07:09.982321+0000","last_peered":"2024-09-10T21:07:09.982321+0000","last_clean":"2024-09-10T21:07:09.982321+0000","last_became_active":"2024-09-10T21:07:08.995845+0000","last_became_peered":"2024-09-10T21:07:08.995845+0000","last_unstale":"2024-09-10T21:07:09.982321+0000","last_undegraded":"2024-09-10T21:07:09.982321+0000","last_fullsized":"2024-09-10T21:07:09.982321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:08.782273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981739+0000","last_change":"2024-09-10T21:07:07.974580+0000","last_active":"2024-09-10T21:07:09.981739+0000","last_peered":"2024-09-10T21:07:09.981739+0000","last_clean":"2024-09-10T21:07:09.981739+0000","last_became_active":"2024-09-10T21:07:07.974287+0000","last_became_peered":"2024-09-10T21:07:07.974287+0000","last_unstale":"2024-09-10T21:07:09.981739+0000","last_undegraded":"2024-09-10T21:07:09.981739+0000","last_fullsized":"2024-09-10T21:07:09.981739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:43.257928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988494+0000","last_change":"2024-09-10T21:07:08.990713+0000","last_active":"2024-09-10T21:07:09.988494+0000","last_peered":"2024-09-10T21:07:09.988494+0000","last_clean":"2024-09-10T21:07:09.988494+0000","last_became_active":"2024-09-10T21:07:08.990447+0000","last_became_peered":"2024-09-10T21:07:08.990447+0000","last_unstale":"2024-09-10T21:07:09.988494+0000","last_undegraded":"2024-09-10T21:07:09.988494+0000","last_fullsized":"2024-09-10T21:07:09.988494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.969223+0000","last_change":"2024-09-10T21:07:07.982710+0000","last_active":"2024-09-10T21:07:08.969223+0000","last_peered":"2024-09-10T21:07:08.969223+0000","last_clean":"2024-09-10T21:07:08.969223+0000","last_became_active":"2024-09-10T21:07:07.982189+0000","last_became_peered":"2024-09-10T21:07:07.982189+0000","last_unstale":"2024-09-10T21:07:08.969223+0000","last_undegraded":"2024-09-10T21:07:08.969223+0000","last_fullsized":"2024-09-10T21:07:08.969223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:21.481889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983543+0000","last_change":"2024-09-10T21:07:09.003185+0000","last_active":"2024-09-10T21:07:09.983543+0000","last_peered":"2024-09-10T21:07:09.983543+0000","last_clean":"2024-09-10T21:07:09.983543+0000","last_became_active":"2024-09-10T21:07:09.002210+0000","last_became_peered":"2024-09-10T21:07:09.002210+0000","last_unstale":"2024-09-10T21:07:09.983543+0000","last_undegraded":"2024-09-10T21:07:09.983543+0000","last_fullsized":"2024-09-10T21:07:09.983543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.014308+0000","last_change":"2024-09-10T21:07:07.977268+0000","last_active":"2024-09-10T21:07:09.014308+0000","last_peered":"2024-09-10T21:07:09.014308+0000","last_clean":"2024-09-10T21:07:09.014308+0000","last_became_active":"2024-09-10T21:07:07.977016+0000","last_became_peered":"2024-09-10T21:07:07.977016+0000","last_unstale":"2024-09-10T21:07:09.014308+0000","last_undegraded":"2024-09-10T21:07:09.014308+0000","last_fullsized":"2024-09-10T21:07:09.014308+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982259+0000","last_change":"2024-09-10T21:07:08.996569+0000","last_active":"2024-09-10T21:07:09.982259+0000","last_peered":"2024-09-10T21:07:09.982259+0000","last_clean":"2024-09-10T21:07:09.982259+0000","last_became_active":"2024-09-10T21:07:08.996285+0000","last_became_peered":"2024-09-10T21:07:08.996285+0000","last_unstale":"2024-09-10T21:07:09.982259+0000","last_undegraded":"2024-09-10T21:07:09.982259+0000","last_fullsized":"2024-09-10T21:07:09.982259+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:35.706362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982755+0000","last_change":"2024-09-10T21:07:07.975307+0000","last_active":"2024-09-10T21:07:09.982755+0000","last_peered":"2024-09-10T21:07:09.982755+0000","last_clean":"2024-09-10T21:07:09.982755+0000","last_became_active":"2024-09-10T21:07:07.975034+0000","last_became_peered":"2024-09-10T21:07:07.975034+0000","last_unstale":"2024-09-10T21:07:09.982755+0000","last_undegraded":"2024-09-10T21:07:09.982755+0000","last_fullsized":"2024-09-10T21:07:09.982755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:59.494549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982671+0000","last_change":"2024-09-10T21:07:08.987536+0000","last_active":"2024-09-10T21:07:09.982671+0000","last_peered":"2024-09-10T21:07:09.982671+0000","last_clean":"2024-09-10T21:07:09.982671+0000","last_became_active":"2024-09-10T21:07:08.987218+0000","last_became_peered":"2024-09-10T21:07:08.987218+0000","last_unstale":"2024-09-10T21:07:09.982671+0000","last_undegraded":"2024-09-10T21:07:09.982671+0000","last_fullsized":"2024-09-10T21:07:09.982671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009907+0000","last_change":"2024-09-10T21:07:07.975529+0000","last_active":"2024-09-10T21:07:09.009907+0000","last_peered":"2024-09-10T21:07:09.009907+0000","last_clean":"2024-09-10T21:07:09.009907+0000","last_became_active":"2024-09-10T21:07:07.974601+0000","last_became_peered":"2024-09-10T21:07:07.974601+0000","last_unstale":"2024-09-10T21:07:09.009907+0000","last_undegraded":"2024-09-10T21:07:09.009907+0000","last_fullsized":"2024-09-10T21:07:09.009907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:15.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982837+0000","last_change":"2024-09-10T21:07:08.994668+0000","last_active":"2024-09-10T21:07:09.982837+0000","last_peered":"2024-09-10T21:07:09.982837+0000","last_clean":"2024-09-10T21:07:09.982837+0000","last_became_active":"2024-09-10T21:07:08.994384+0000","last_became_peered":"2024-09-10T21:07:08.994384+0000","last_unstale":"2024-09-10T21:07:09.982837+0000","last_undegraded":"2024-09-10T21:07:09.982837+0000","last_fullsized":"2024-09-10T21:07:09.982837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:14.061765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983445+0000","last_change":"2024-09-10T21:07:07.984389+0000","last_active":"2024-09-10T21:07:09.983445+0000","last_peered":"2024-09-10T21:07:09.983445+0000","last_clean":"2024-09-10T21:07:09.983445+0000","last_became_active":"2024-09-10T21:07:07.983958+0000","last_became_peered":"2024-09-10T21:07:07.983958+0000","last_unstale":"2024-09-10T21:07:09.983445+0000","last_undegraded":"2024-09-10T21:07:09.983445+0000","last_fullsized":"2024-09-10T21:07:09.983445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:38.916517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-10T21:07:06.963205+0000","last_change":"2024-09-10T21:07:06.963205+0000","last_active":"2024-09-10T21:07:06.943662+0000","last_peered":"2024-09-10T21:07:06.943662+0000","last_clean":"2024-09-10T21:07:06.943662+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:06.963205+0000","last_undegraded":"2024-09-10T21:07:06.963205+0000","last_fullsized":"2024-09-10T21:07:06.963205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991928+0000","last_change":"2024-09-10T21:07:08.985488+0000","last_active":"2024-09-10T21:07:08.991928+0000","last_peered":"2024-09-10T21:07:08.991928+0000","last_clean":"2024-09-10T21:07:08.991928+0000","last_became_active":"2024-09-10T21:07:08.985240+0000","last_became_peered":"2024-09-10T21:07:08.985240+0000","last_unstale":"2024-09-10T21:07:08.991928+0000","last_undegraded":"2024-09-10T21:07:08.991928+0000","last_fullsized":"2024-09-10T21:07:08.991928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:21.219197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-10T21:07:06.963180+0000","last_change":"2024-09-10T21:07:06.963180+0000","last_active":"2024-09-10T21:07:06.943662+0000","last_peered":"2024-09-10T21:07:06.943662+0000","last_clean":"2024-09-10T21:07:06.943662+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:06.963180+0000","last_undegraded":"2024-09-10T21:07:06.963180+0000","last_fullsized":"2024-09-10T21:07:06.963180+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006712+0000","last_change":"2024-09-10T21:07:08.994822+0000","last_active":"2024-09-10T21:07:09.006712+0000","last_peered":"2024-09-10T21:07:09.006712+0000","last_clean":"2024-09-10T21:07:09.006712+0000","last_became_active":"2024-09-10T21:07:08.994580+0000","last_became_peered":"2024-09-10T21:07:08.994580+0000","last_unstale":"2024-09-10T21:07:09.006712+0000","last_undegraded":"2024-09-10T21:07:09.006712+0000","last_fullsized":"2024-09-10T21:07:09.006712+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981844+0000","last_change":"2024-09-10T21:07:07.970920+0000","last_active":"2024-09-10T21:07:09.981844+0000","last_peered":"2024-09-10T21:07:09.981844+0000","last_clean":"2024-09-10T21:07:09.981844+0000","last_became_active":"2024-09-10T21:07:07.970301+0000","last_became_peered":"2024-09-10T21:07:07.970301+0000","last_unstale":"2024-09-10T21:07:09.981844+0000","last_undegraded":"2024-09-10T21:07:09.981844+0000","last_fullsized":"2024-09-10T21:07:09.981844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988171+0000","last_change":"2024-09-10T21:07:08.990744+0000","last_active":"2024-09-10T21:07:09.988171+0000","last_peered":"2024-09-10T21:07:09.988171+0000","last_clean":"2024-09-10T21:07:09.988171+0000","last_became_active":"2024-09-10T21:07:08.989163+0000","last_became_peered":"2024-09-10T21:07:08.989163+0000","last_unstale":"2024-09-10T21:07:09.988171+0000","last_undegraded":"2024-09-10T21:07:09.988171+0000","last_fullsized":"2024-09-10T21:07:09.988171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982544+0000","last_change":"2024-09-10T21:07:07.974215+0000","last_active":"2024-09-10T21:07:09.982544+0000","last_peered":"2024-09-10T21:07:09.982544+0000","last_clean":"2024-09-10T21:07:09.982544+0000","last_became_active":"2024-09-10T21:07:07.973960+0000","last_became_peered":"2024-09-10T21:07:07.973960+0000","last_unstale":"2024-09-10T21:07:09.982544+0000","last_undegraded":"2024-09-10T21:07:09.982544+0000","last_fullsized":"2024-09-10T21:07:09.982544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.040936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009159+0000","last_change":"2024-09-10T21:07:09.004117+0000","last_active":"2024-09-10T21:07:09.009159+0000","last_peered":"2024-09-10T21:07:09.009159+0000","last_clean":"2024-09-10T21:07:09.009159+0000","last_became_active":"2024-09-10T21:07:09.003435+0000","last_became_peered":"2024-09-10T21:07:09.003435+0000","last_unstale":"2024-09-10T21:07:09.009159+0000","last_undegraded":"2024-09-10T21:07:09.009159+0000","last_fullsized":"2024-09-10T21:07:09.009159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981579+0000","last_change":"2024-09-10T21:07:07.975653+0000","last_active":"2024-09-10T21:07:09.981579+0000","last_peered":"2024-09-10T21:07:09.981579+0000","last_clean":"2024-09-10T21:07:09.981579+0000","last_became_active":"2024-09-10T21:07:07.975383+0000","last_became_peered":"2024-09-10T21:07:07.975383+0000","last_unstale":"2024-09-10T21:07:09.981579+0000","last_undegraded":"2024-09-10T21:07:09.981579+0000","last_fullsized":"2024-09-10T21:07:09.981579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:24.484277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983577+0000","last_change":"2024-09-10T21:07:09.003571+0000","last_active":"2024-09-10T21:07:09.983577+0000","last_peered":"2024-09-10T21:07:09.983577+0000","last_clean":"2024-09-10T21:07:09.983577+0000","last_became_active":"2024-09-10T21:07:09.003282+0000","last_became_peered":"2024-09-10T21:07:09.003282+0000","last_unstale":"2024-09-10T21:07:09.983577+0000","last_undegraded":"2024-09-10T21:07:09.983577+0000","last_fullsized":"2024-09-10T21:07:09.983577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.004958+0000","last_change":"2024-09-10T21:07:07.982369+0000","last_active":"2024-09-10T21:07:09.004958+0000","last_peered":"2024-09-10T21:07:09.004958+0000","last_clean":"2024-09-10T21:07:09.004958+0000","last_became_active":"2024-09-10T21:07:07.982077+0000","last_became_peered":"2024-09-10T21:07:07.982077+0000","last_unstale":"2024-09-10T21:07:09.004958+0000","last_undegraded":"2024-09-10T21:07:09.004958+0000","last_fullsized":"2024-09-10T21:07:09.004958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:40.539770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988694+0000","last_change":"2024-09-10T21:07:08.989455+0000","last_active":"2024-09-10T21:07:09.988694+0000","last_peered":"2024-09-10T21:07:09.988694+0000","last_clean":"2024-09-10T21:07:09.988694+0000","last_became_active":"2024-09-10T21:07:08.989206+0000","last_became_peered":"2024-09-10T21:07:08.989206+0000","last_unstale":"2024-09-10T21:07:09.988694+0000","last_undegraded":"2024-09-10T21:07:09.988694+0000","last_fullsized":"2024-09-10T21:07:09.988694+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.987453+0000","last_change":"2024-09-10T21:07:07.984174+0000","last_active":"2024-09-10T21:07:09.987453+0000","last_peered":"2024-09-10T21:07:09.987453+0000","last_clean":"2024-09-10T21:07:09.987453+0000","last_became_active":"2024-09-10T21:07:07.983898+0000","last_became_peered":"2024-09-10T21:07:07.983898+0000","last_unstale":"2024-09-10T21:07:09.987453+0000","last_undegraded":"2024-09-10T21:07:09.987453+0000","last_fullsized":"2024-09-10T21:07:09.987453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983503+0000","last_change":"2024-09-10T21:07:07.982520+0000","last_active":"2024-09-10T21:07:09.983503+0000","last_peered":"2024-09-10T21:07:09.983503+0000","last_clean":"2024-09-10T21:07:09.983503+0000","last_became_active":"2024-09-10T21:07:07.982215+0000","last_became_peered":"2024-09-10T21:07:07.982215+0000","last_unstale":"2024-09-10T21:07:09.983503+0000","last_undegraded":"2024-09-10T21:07:09.983503+0000","last_fullsized":"2024-09-10T21:07:09.983503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:38.024808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982590+0000","last_change":"2024-09-10T21:07:09.000771+0000","last_active":"2024-09-10T21:07:09.982590+0000","last_peered":"2024-09-10T21:07:09.982590+0000","last_clean":"2024-09-10T21:07:09.982590+0000","last_became_active":"2024-09-10T21:07:09.000225+0000","last_became_peered":"2024-09-10T21:07:09.000225+0000","last_unstale":"2024-09-10T21:07:09.982590+0000","last_undegraded":"2024-09-10T21:07:09.982590+0000","last_fullsized":"2024-09-10T21:07:09.982590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.975892+0000","last_change":"2024-09-10T21:07:07.972550+0000","last_active":"2024-09-10T21:07:08.975892+0000","last_peered":"2024-09-10T21:07:08.975892+0000","last_clean":"2024-09-10T21:07:08.975892+0000","last_became_active":"2024-09-10T21:07:07.972258+0000","last_became_peered":"2024-09-10T21:07:07.972258+0000","last_unstale":"2024-09-10T21:07:08.975892+0000","last_undegraded":"2024-09-10T21:07:08.975892+0000","last_fullsized":"2024-09-10T21:07:08.975892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:54.175968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981812+0000","last_change":"2024-09-10T21:07:08.993085+0000","last_active":"2024-09-10T21:07:09.981812+0000","last_peered":"2024-09-10T21:07:09.981812+0000","last_clean":"2024-09-10T21:07:09.981812+0000","last_became_active":"2024-09-10T21:07:08.992693+0000","last_became_peered":"2024-09-10T21:07:08.992693+0000","last_unstale":"2024-09-10T21:07:09.981812+0000","last_undegraded":"2024-09-10T21:07:09.981812+0000","last_fullsized":"2024-09-10T21:07:09.981812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:29.416774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988406+0000","last_change":"2024-09-10T21:07:07.984281+0000","last_active":"2024-09-10T21:07:09.988406+0000","last_peered":"2024-09-10T21:07:09.988406+0000","last_clean":"2024-09-10T21:07:09.988406+0000","last_became_active":"2024-09-10T21:07:07.983954+0000","last_became_peered":"2024-09-10T21:07:07.983954+0000","last_unstale":"2024-09-10T21:07:09.988406+0000","last_undegraded":"2024-09-10T21:07:09.988406+0000","last_fullsized":"2024-09-10T21:07:09.988406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:15.341376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.989535+0000","last_change":"2024-09-10T21:07:08.982222+0000","last_active":"2024-09-10T21:07:08.989535+0000","last_peered":"2024-09-10T21:07:08.989535+0000","last_clean":"2024-09-10T21:07:08.989535+0000","last_became_active":"2024-09-10T21:07:08.981942+0000","last_became_peered":"2024-09-10T21:07:08.981942+0000","last_unstale":"2024-09-10T21:07:08.989535+0000","last_undegraded":"2024-09-10T21:07:08.989535+0000","last_fullsized":"2024-09-10T21:07:08.989535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:18.777246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.969247+0000","last_change":"2024-09-10T21:07:07.982359+0000","last_active":"2024-09-10T21:07:08.969247+0000","last_peered":"2024-09-10T21:07:08.969247+0000","last_clean":"2024-09-10T21:07:08.969247+0000","last_became_active":"2024-09-10T21:07:07.982087+0000","last_became_peered":"2024-09-10T21:07:07.982087+0000","last_unstale":"2024-09-10T21:07:08.969247+0000","last_undegraded":"2024-09-10T21:07:08.969247+0000","last_fullsized":"2024-09-10T21:07:08.969247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:44.164885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988331+0000","last_change":"2024-09-10T21:07:08.994477+0000","last_active":"2024-09-10T21:07:09.988331+0000","last_peered":"2024-09-10T21:07:09.988331+0000","last_clean":"2024-09-10T21:07:09.988331+0000","last_became_active":"2024-09-10T21:07:08.994228+0000","last_became_peered":"2024-09-10T21:07:08.994228+0000","last_unstale":"2024-09-10T21:07:09.988331+0000","last_undegraded":"2024-09-10T21:07:09.988331+0000","last_fullsized":"2024-09-10T21:07:09.988331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.972673+0000","last_change":"2024-09-10T21:07:07.977266+0000","last_active":"2024-09-10T21:07:08.972673+0000","last_peered":"2024-09-10T21:07:08.972673+0000","last_clean":"2024-09-10T21:07:08.972673+0000","last_became_active":"2024-09-10T21:07:07.976927+0000","last_became_peered":"2024-09-10T21:07:07.976927+0000","last_unstale":"2024-09-10T21:07:08.972673+0000","last_undegraded":"2024-09-10T21:07:08.972673+0000","last_fullsized":"2024-09-10T21:07:08.972673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:04.086693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.001054+0000","last_change":"2024-09-10T21:07:08.996299+0000","last_active":"2024-09-10T21:07:09.001054+0000","last_peered":"2024-09-10T21:07:09.001054+0000","last_clean":"2024-09-10T21:07:09.001054+0000","last_became_active":"2024-09-10T21:07:08.995907+0000","last_became_peered":"2024-09-10T21:07:08.995907+0000","last_unstale":"2024-09-10T21:07:09.001054+0000","last_undegraded":"2024-09-10T21:07:09.001054+0000","last_fullsized":"2024-09-10T21:07:09.001054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:37.059713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988421+0000","last_change":"2024-09-10T21:07:07.979476+0000","last_active":"2024-09-10T21:07:09.988421+0000","last_peered":"2024-09-10T21:07:09.988421+0000","last_clean":"2024-09-10T21:07:09.988421+0000","last_became_active":"2024-09-10T21:07:07.979192+0000","last_became_peered":"2024-09-10T21:07:07.979192+0000","last_unstale":"2024-09-10T21:07:09.988421+0000","last_undegraded":"2024-09-10T21:07:09.988421+0000","last_fullsized":"2024-09-10T21:07:09.988421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:25.005206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982211+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:09.982211+0000","last_peered":"2024-09-10T21:07:09.982211+0000","last_clean":"2024-09-10T21:07:09.982211+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:09.982211+0000","last_undegraded":"2024-09-10T21:07:09.982211+0000","last_fullsized":"2024-09-10T21:07:09.982211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":195285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":193639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":195743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1064960,"data_stored":790631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":770083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:13.612 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.801+0000 7f1a64a00640 1 -- 172.21.15.100:0/2562127378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a6015c750 msgr2=0x7f1a600cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.801+0000 7f1a64a00640 1 --2- 172.21.15.100:0/2562127378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a6015c750 0x7f1a600cf780 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1a600cd590 tx=0x7f1a5802aac0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.801+0000 7f1a64a00640 1 -- 172.21.15.100:0/2562127378 shutdown_connections 2024-09-10T21:07:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.801+0000 7f1a64a00640 1 --2- 172.21.15.100:0/2562127378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a6015c750 0x7f1a600cf780 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.801+0000 7f1a64a00640 1 --2- 172.21.15.100:0/2562127378 >> v2:172.21.15.130:3300/0 conn(0x7f1a600741e0 0x7f1a6015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.801+0000 7f1a64a00640 1 -- 172.21.15.100:0/2562127378 >> 172.21.15.100:0/2562127378 conn(0x7f1a6006cb50 msgr2=0x7f1a6006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.801+0000 7f1a64a00640 1 -- 172.21.15.100:0/2562127378 shutdown_connections 2024-09-10T21:07:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.801+0000 7f1a64a00640 1 -- 172.21.15.100:0/2562127378 wait complete. 2024-09-10T21:07:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.803+0000 7f1a64a00640 1 Processor -- start 2024-09-10T21:07:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.803+0000 7f1a64a00640 1 -- start start 2024-09-10T21:07:13.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a64a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a600741e0 0x7f1a6014d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:13.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a64a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a6015b680 0x7f1a600ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:13.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a64a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6015c750 0x7f1a600ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:13.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a64a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a600b2860 con 0x7f1a600741e0 2024-09-10T21:07:13.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a64a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a600b29e0 con 0x7f1a6015c750 2024-09-10T21:07:13.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a64a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1a600b2b60 con 0x7f1a6015b680 2024-09-10T21:07:13.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a5de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a600741e0 0x7f1a6014d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a5de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a600741e0 0x7f1a6014d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32920/0 (socket says 172.21.15.100:32920) 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a5de00640 1 -- 172.21.15.100:0/1961861845 learned_addr learned my addr 172.21.15.100:0/1961861845 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a5d400640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a6015b680 0x7f1a600ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.804+0000 7f1a5e800640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6015c750 0x7f1a600ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a5de00640 1 -- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a6015b680 msgr2=0x7f1a600ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a5de00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a6015b680 0x7f1a600ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a5de00640 1 -- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6015c750 msgr2=0x7f1a600ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a5de00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6015c750 0x7f1a600ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a5de00640 1 -- 172.21.15.100:0/1961861845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a600aedd0 con 0x7f1a600741e0 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a5e800640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6015c750 0x7f1a600ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a5de00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a600741e0 0x7f1a6014d2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c480 tx=0x7f1a5000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a56000640 1 -- 172.21.15.100:0/1961861845 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a500052d0 con 0x7f1a600741e0 2024-09-10T21:07:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a56000640 1 -- 172.21.15.100:0/1961861845 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a50005470 con 0x7f1a600741e0 2024-09-10T21:07:13.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a56000640 1 -- 172.21.15.100:0/1961861845 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50012870 con 0x7f1a600741e0 2024-09-10T21:07:13.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a600af0b0 con 0x7f1a600741e0 2024-09-10T21:07:13.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.805+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a600af7b0 con 0x7f1a600741e0 2024-09-10T21:07:13.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.806+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a600b3080 con 0x7f1a600741e0 2024-09-10T21:07:13.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.807+0000 7f1a56000640 1 -- 172.21.15.100:0/1961861845 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1a500035f0 con 0x7f1a600741e0 2024-09-10T21:07:13.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.808+0000 7f1a56000640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1a40077f70 0x7f1a4007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:13.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.808+0000 7f1a56000640 1 -- 172.21.15.100:0/1961861845 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f1a50099970 con 0x7f1a600741e0 2024-09-10T21:07:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.809+0000 7f1a5d400640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1a40077f70 0x7f1a4007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.809+0000 7f1a5d400640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1a40077f70 0x7f1a4007a430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a601f7e40 tx=0x7f1a4c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:13.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.812+0000 7f1a56000640 1 -- 172.21.15.100:0/1961861845 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1a50062370 con 0x7f1a600741e0 2024-09-10T21:07:13.821 INFO:tasks.ceph.mds.d.smithi130.stderr:2024-09-10T21:07:13.817+0000 7f9a7f400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T21:07:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.993+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a6006ad80 con 0x7f1a40077f70 2024-09-10T21:07:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:13.998+0000 7f1a56000640 1 -- 172.21.15.100:0/1961861845 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251208 (secure 0 0 0) 0x7f1a6006ad80 con 0x7f1a40077f70 2024-09-10T21:07:14.006 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:14.007 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:14.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1a40077f70 msgr2=0x7f1a4007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1a40077f70 0x7f1a4007a430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a601f7e40 tx=0x7f1a4c005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:14.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a600741e0 msgr2=0x7f1a6014d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a600741e0 0x7f1a6014d2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c480 tx=0x7f1a5000c940 comp rx=0 tx=0).stop 2024-09-10T21:07:14.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 shutdown_connections 2024-09-10T21:07:14.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1a40077f70 0x7f1a4007a430 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6015c750 0x7f1a600ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a6015b680 0x7f1a600ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 --2- 172.21.15.100:0/1961861845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a600741e0 0x7f1a6014d2f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 >> 172.21.15.100:0/1961861845 conn(0x7f1a6006cb50 msgr2=0x7f1a6006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:14.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.002+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 shutdown_connections 2024-09-10T21:07:14.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.003+0000 7f1a64a00640 1 -- 172.21.15.100:0/1961861845 wait complete. 2024-09-10T21:07:14.024 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-10T21:07:12.704101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221048,"kb_used_data":4796,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753672,"statfs":{"total":773094113280,"available":772867760128,"internally_reserved":0,"allocated":4911104,"data_stored":2746300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750773"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006398+0000","last_change":"2024-09-10T21:07:08.993655+0000","last_active":"2024-09-10T21:07:09.006398+0000","last_peered":"2024-09-10T21:07:09.006398+0000","last_clean":"2024-09-10T21:07:09.006398+0000","last_became_active":"2024-09-10T21:07:08.991972+0000","last_became_peered":"2024-09-10T21:07:08.991972+0000","last_unstale":"2024-09-10T21:07:09.006398+0000","last_undegraded":"2024-09-10T21:07:09.006398+0000","last_fullsized":"2024-09-10T21:07:09.006398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:42.045631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983097+0000","last_change":"2024-09-10T21:07:08.993612+0000","last_active":"2024-09-10T21:07:09.983097+0000","last_peered":"2024-09-10T21:07:09.983097+0000","last_clean":"2024-09-10T21:07:09.983097+0000","last_became_active":"2024-09-10T21:07:08.993291+0000","last_became_peered":"2024-09-10T21:07:08.993291+0000","last_unstale":"2024-09-10T21:07:09.983097+0000","last_undegraded":"2024-09-10T21:07:09.983097+0000","last_fullsized":"2024-09-10T21:07:09.983097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.998149+0000","last_change":"2024-09-10T21:07:08.986654+0000","last_active":"2024-09-10T21:07:08.998149+0000","last_peered":"2024-09-10T21:07:08.998149+0000","last_clean":"2024-09-10T21:07:08.998149+0000","last_became_active":"2024-09-10T21:07:08.986313+0000","last_became_peered":"2024-09-10T21:07:08.986313+0000","last_unstale":"2024-09-10T21:07:08.998149+0000","last_undegraded":"2024-09-10T21:07:08.998149+0000","last_fullsized":"2024-09-10T21:07:08.998149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.007251+0000","last_change":"2024-09-10T21:07:08.992089+0000","last_active":"2024-09-10T21:07:09.007251+0000","last_peered":"2024-09-10T21:07:09.007251+0000","last_clean":"2024-09-10T21:07:09.007251+0000","last_became_active":"2024-09-10T21:07:08.991795+0000","last_became_peered":"2024-09-10T21:07:08.991795+0000","last_unstale":"2024-09-10T21:07:09.007251+0000","last_undegraded":"2024-09-10T21:07:09.007251+0000","last_fullsized":"2024-09-10T21:07:09.007251+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983410+0000","last_change":"2024-09-10T21:07:09.006257+0000","last_active":"2024-09-10T21:07:09.983410+0000","last_peered":"2024-09-10T21:07:09.983410+0000","last_clean":"2024-09-10T21:07:09.983410+0000","last_became_active":"2024-09-10T21:07:09.005851+0000","last_became_peered":"2024-09-10T21:07:09.005851+0000","last_unstale":"2024-09-10T21:07:09.983410+0000","last_undegraded":"2024-09-10T21:07:09.983410+0000","last_fullsized":"2024-09-10T21:07:09.983410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981787+0000","last_change":"2024-09-10T21:07:08.985543+0000","last_active":"2024-09-10T21:07:09.981787+0000","last_peered":"2024-09-10T21:07:09.981787+0000","last_clean":"2024-09-10T21:07:09.981787+0000","last_became_active":"2024-09-10T21:07:08.981933+0000","last_became_peered":"2024-09-10T21:07:08.981933+0000","last_unstale":"2024-09-10T21:07:09.981787+0000","last_undegraded":"2024-09-10T21:07:09.981787+0000","last_fullsized":"2024-09-10T21:07:09.981787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:55.184003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982434+0000","last_change":"2024-09-10T21:07:08.991775+0000","last_active":"2024-09-10T21:07:09.982434+0000","last_peered":"2024-09-10T21:07:09.982434+0000","last_clean":"2024-09-10T21:07:09.982434+0000","last_became_active":"2024-09-10T21:07:08.991499+0000","last_became_peered":"2024-09-10T21:07:08.991499+0000","last_unstale":"2024-09-10T21:07:09.982434+0000","last_undegraded":"2024-09-10T21:07:09.982434+0000","last_fullsized":"2024-09-10T21:07:09.982434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008785+0000","last_change":"2024-09-10T21:07:09.003113+0000","last_active":"2024-09-10T21:07:09.008785+0000","last_peered":"2024-09-10T21:07:09.008785+0000","last_clean":"2024-09-10T21:07:09.008785+0000","last_became_active":"2024-09-10T21:07:09.002875+0000","last_became_peered":"2024-09-10T21:07:09.002875+0000","last_unstale":"2024-09-10T21:07:09.008785+0000","last_undegraded":"2024-09-10T21:07:09.008785+0000","last_fullsized":"2024-09-10T21:07:09.008785+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:25.364850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983824+0000","last_change":"2024-09-10T21:07:08.995695+0000","last_active":"2024-09-10T21:07:09.983824+0000","last_peered":"2024-09-10T21:07:09.983824+0000","last_clean":"2024-09-10T21:07:09.983824+0000","last_became_active":"2024-09-10T21:07:08.995450+0000","last_became_peered":"2024-09-10T21:07:08.995450+0000","last_unstale":"2024-09-10T21:07:09.983824+0000","last_undegraded":"2024-09-10T21:07:09.983824+0000","last_fullsized":"2024-09-10T21:07:09.983824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982683+0000","last_change":"2024-09-10T21:07:08.987778+0000","last_active":"2024-09-10T21:07:09.982683+0000","last_peered":"2024-09-10T21:07:09.982683+0000","last_clean":"2024-09-10T21:07:09.982683+0000","last_became_active":"2024-09-10T21:07:08.987558+0000","last_became_peered":"2024-09-10T21:07:08.987558+0000","last_unstale":"2024-09-10T21:07:09.982683+0000","last_undegraded":"2024-09-10T21:07:09.982683+0000","last_fullsized":"2024-09-10T21:07:09.982683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:26.013241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988586+0000","last_change":"2024-09-10T21:07:09.004347+0000","last_active":"2024-09-10T21:07:09.988586+0000","last_peered":"2024-09-10T21:07:09.988586+0000","last_clean":"2024-09-10T21:07:09.988586+0000","last_became_active":"2024-09-10T21:07:09.004076+0000","last_became_peered":"2024-09-10T21:07:09.004076+0000","last_unstale":"2024-09-10T21:07:09.988586+0000","last_undegraded":"2024-09-10T21:07:09.988586+0000","last_fullsized":"2024-09-10T21:07:09.988586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983673+0000","last_change":"2024-09-10T21:07:09.001468+0000","last_active":"2024-09-10T21:07:09.983673+0000","last_peered":"2024-09-10T21:07:09.983673+0000","last_clean":"2024-09-10T21:07:09.983673+0000","last_became_active":"2024-09-10T21:07:09.001207+0000","last_became_peered":"2024-09-10T21:07:09.001207+0000","last_unstale":"2024-09-10T21:07:09.983673+0000","last_undegraded":"2024-09-10T21:07:09.983673+0000","last_fullsized":"2024-09-10T21:07:09.983673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982349+0000","last_change":"2024-09-10T21:07:08.995284+0000","last_active":"2024-09-10T21:07:09.982349+0000","last_peered":"2024-09-10T21:07:09.982349+0000","last_clean":"2024-09-10T21:07:09.982349+0000","last_became_active":"2024-09-10T21:07:08.994529+0000","last_became_peered":"2024-09-10T21:07:08.994529+0000","last_unstale":"2024-09-10T21:07:09.982349+0000","last_undegraded":"2024-09-10T21:07:09.982349+0000","last_fullsized":"2024-09-10T21:07:09.982349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.002042+0000","last_change":"2024-09-10T21:07:08.988477+0000","last_active":"2024-09-10T21:07:09.002042+0000","last_peered":"2024-09-10T21:07:09.002042+0000","last_clean":"2024-09-10T21:07:09.002042+0000","last_became_active":"2024-09-10T21:07:08.988146+0000","last_became_peered":"2024-09-10T21:07:08.988146+0000","last_unstale":"2024-09-10T21:07:09.002042+0000","last_undegraded":"2024-09-10T21:07:09.002042+0000","last_fullsized":"2024-09-10T21:07:09.002042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:37.378222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.998634+0000","last_change":"2024-09-10T21:07:08.992983+0000","last_active":"2024-09-10T21:07:08.998634+0000","last_peered":"2024-09-10T21:07:08.998634+0000","last_clean":"2024-09-10T21:07:08.998634+0000","last_became_active":"2024-09-10T21:07:08.992683+0000","last_became_peered":"2024-09-10T21:07:08.992683+0000","last_unstale":"2024-09-10T21:07:08.998634+0000","last_undegraded":"2024-09-10T21:07:08.998634+0000","last_fullsized":"2024-09-10T21:07:08.998634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:35.716765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982205+0000","last_change":"2024-09-10T21:07:08.982108+0000","last_active":"2024-09-10T21:07:09.982205+0000","last_peered":"2024-09-10T21:07:09.982205+0000","last_clean":"2024-09-10T21:07:09.982205+0000","last_became_active":"2024-09-10T21:07:08.981887+0000","last_became_peered":"2024-09-10T21:07:08.981887+0000","last_unstale":"2024-09-10T21:07:09.982205+0000","last_undegraded":"2024-09-10T21:07:09.982205+0000","last_fullsized":"2024-09-10T21:07:09.982205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991780+0000","last_change":"2024-09-10T21:07:08.986295+0000","last_active":"2024-09-10T21:07:08.991780+0000","last_peered":"2024-09-10T21:07:08.991780+0000","last_clean":"2024-09-10T21:07:08.991780+0000","last_became_active":"2024-09-10T21:07:08.983589+0000","last_became_peered":"2024-09-10T21:07:08.983589+0000","last_unstale":"2024-09-10T21:07:08.991780+0000","last_undegraded":"2024-09-10T21:07:08.991780+0000","last_fullsized":"2024-09-10T21:07:08.991780+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:04.873265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991889+0000","last_change":"2024-09-10T21:07:08.987716+0000","last_active":"2024-09-10T21:07:08.991889+0000","last_peered":"2024-09-10T21:07:08.991889+0000","last_clean":"2024-09-10T21:07:08.991889+0000","last_became_active":"2024-09-10T21:07:08.986131+0000","last_became_peered":"2024-09-10T21:07:08.986131+0000","last_unstale":"2024-09-10T21:07:08.991889+0000","last_undegraded":"2024-09-10T21:07:08.991889+0000","last_fullsized":"2024-09-10T21:07:08.991889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:55.256639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988341+0000","last_change":"2024-09-10T21:07:08.989449+0000","last_active":"2024-09-10T21:07:09.988341+0000","last_peered":"2024-09-10T21:07:09.988341+0000","last_clean":"2024-09-10T21:07:09.988341+0000","last_became_active":"2024-09-10T21:07:08.988365+0000","last_became_peered":"2024-09-10T21:07:08.988365+0000","last_unstale":"2024-09-10T21:07:09.988341+0000","last_undegraded":"2024-09-10T21:07:09.988341+0000","last_fullsized":"2024-09-10T21:07:09.988341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:15.897184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988657+0000","last_change":"2024-09-10T21:07:08.984966+0000","last_active":"2024-09-10T21:07:09.988657+0000","last_peered":"2024-09-10T21:07:09.988657+0000","last_clean":"2024-09-10T21:07:09.988657+0000","last_became_active":"2024-09-10T21:07:08.984696+0000","last_became_peered":"2024-09-10T21:07:08.984696+0000","last_unstale":"2024-09-10T21:07:09.988657+0000","last_undegraded":"2024-09-10T21:07:09.988657+0000","last_fullsized":"2024-09-10T21:07:09.988657+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:48.470274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988163+0000","last_change":"2024-09-10T21:07:08.992572+0000","last_active":"2024-09-10T21:07:09.988163+0000","last_peered":"2024-09-10T21:07:09.988163+0000","last_clean":"2024-09-10T21:07:09.988163+0000","last_became_active":"2024-09-10T21:07:08.992231+0000","last_became_peered":"2024-09-10T21:07:08.992231+0000","last_unstale":"2024-09-10T21:07:09.988163+0000","last_undegraded":"2024-09-10T21:07:09.988163+0000","last_fullsized":"2024-09-10T21:07:09.988163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.996609+0000","last_change":"2024-09-10T21:07:08.990954+0000","last_active":"2024-09-10T21:07:08.996609+0000","last_peered":"2024-09-10T21:07:08.996609+0000","last_clean":"2024-09-10T21:07:08.996609+0000","last_became_active":"2024-09-10T21:07:08.989166+0000","last_became_peered":"2024-09-10T21:07:08.989166+0000","last_unstale":"2024-09-10T21:07:08.996609+0000","last_undegraded":"2024-09-10T21:07:08.996609+0000","last_fullsized":"2024-09-10T21:07:08.996609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:48.434984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008398+0000","last_change":"2024-09-10T21:07:08.998488+0000","last_active":"2024-09-10T21:07:09.008398+0000","last_peered":"2024-09-10T21:07:09.008398+0000","last_clean":"2024-09-10T21:07:09.008398+0000","last_became_active":"2024-09-10T21:07:08.997677+0000","last_became_peered":"2024-09-10T21:07:08.997677+0000","last_unstale":"2024-09-10T21:07:09.008398+0000","last_undegraded":"2024-09-10T21:07:09.008398+0000","last_fullsized":"2024-09-10T21:07:09.008398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:06:30.641657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008530+0000","last_change":"2024-09-10T21:07:09.003139+0000","last_active":"2024-09-10T21:07:09.008530+0000","last_peered":"2024-09-10T21:07:09.008530+0000","last_clean":"2024-09-10T21:07:09.008530+0000","last_became_active":"2024-09-10T21:07:09.002972+0000","last_became_peered":"2024-09-10T21:07:09.002972+0000","last_unstale":"2024-09-10T21:07:09.008530+0000","last_undegraded":"2024-09-10T21:07:09.008530+0000","last_fullsized":"2024-09-10T21:07:09.008530+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008454+0000","last_change":"2024-09-10T21:07:08.998658+0000","last_active":"2024-09-10T21:07:09.008454+0000","last_peered":"2024-09-10T21:07:09.008454+0000","last_clean":"2024-09-10T21:07:09.008454+0000","last_became_active":"2024-09-10T21:07:08.993838+0000","last_became_peered":"2024-09-10T21:07:08.993838+0000","last_unstale":"2024-09-10T21:07:09.008454+0000","last_undegraded":"2024-09-10T21:07:09.008454+0000","last_fullsized":"2024-09-10T21:07:09.008454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988654+0000","last_change":"2024-09-10T21:07:08.997383+0000","last_active":"2024-09-10T21:07:09.988654+0000","last_peered":"2024-09-10T21:07:09.988654+0000","last_clean":"2024-09-10T21:07:09.988654+0000","last_became_active":"2024-09-10T21:07:08.997089+0000","last_became_peered":"2024-09-10T21:07:08.997089+0000","last_unstale":"2024-09-10T21:07:09.988654+0000","last_undegraded":"2024-09-10T21:07:09.988654+0000","last_fullsized":"2024-09-10T21:07:09.988654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982632+0000","last_change":"2024-09-10T21:07:08.993822+0000","last_active":"2024-09-10T21:07:09.982632+0000","last_peered":"2024-09-10T21:07:09.982632+0000","last_clean":"2024-09-10T21:07:09.982632+0000","last_became_active":"2024-09-10T21:07:08.991716+0000","last_became_peered":"2024-09-10T21:07:08.991716+0000","last_unstale":"2024-09-10T21:07:09.982632+0000","last_undegraded":"2024-09-10T21:07:09.982632+0000","last_fullsized":"2024-09-10T21:07:09.982632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993244+0000","last_change":"2024-09-10T21:07:08.988982+0000","last_active":"2024-09-10T21:07:08.993244+0000","last_peered":"2024-09-10T21:07:08.993244+0000","last_clean":"2024-09-10T21:07:08.993244+0000","last_became_active":"2024-09-10T21:07:08.988654+0000","last_became_peered":"2024-09-10T21:07:08.988654+0000","last_unstale":"2024-09-10T21:07:08.993244+0000","last_undegraded":"2024-09-10T21:07:08.993244+0000","last_fullsized":"2024-09-10T21:07:08.993244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:46.803121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993168+0000","last_change":"2024-09-10T21:07:08.989788+0000","last_active":"2024-09-10T21:07:08.993168+0000","last_peered":"2024-09-10T21:07:08.993168+0000","last_clean":"2024-09-10T21:07:08.993168+0000","last_became_active":"2024-09-10T21:07:08.988825+0000","last_became_peered":"2024-09-10T21:07:08.988825+0000","last_unstale":"2024-09-10T21:07:08.993168+0000","last_undegraded":"2024-09-10T21:07:08.993168+0000","last_fullsized":"2024-09-10T21:07:08.993168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.855818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982533+0000","last_change":"2024-09-10T21:07:08.982659+0000","last_active":"2024-09-10T21:07:09.982533+0000","last_peered":"2024-09-10T21:07:09.982533+0000","last_clean":"2024-09-10T21:07:09.982533+0000","last_became_active":"2024-09-10T21:07:08.982365+0000","last_became_peered":"2024-09-10T21:07:08.982365+0000","last_unstale":"2024-09-10T21:07:09.982533+0000","last_undegraded":"2024-09-10T21:07:09.982533+0000","last_fullsized":"2024-09-10T21:07:09.982533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008381+0000","last_change":"2024-09-10T21:07:08.998256+0000","last_active":"2024-09-10T21:07:09.008381+0000","last_peered":"2024-09-10T21:07:09.008381+0000","last_clean":"2024-09-10T21:07:09.008381+0000","last_became_active":"2024-09-10T21:07:08.994815+0000","last_became_peered":"2024-09-10T21:07:08.994815+0000","last_unstale":"2024-09-10T21:07:09.008381+0000","last_undegraded":"2024-09-10T21:07:09.008381+0000","last_fullsized":"2024-09-10T21:07:09.008381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993127+0000","last_change":"2024-09-10T21:07:08.989239+0000","last_active":"2024-09-10T21:07:08.993127+0000","last_peered":"2024-09-10T21:07:08.993127+0000","last_clean":"2024-09-10T21:07:08.993127+0000","last_became_active":"2024-09-10T21:07:08.988990+0000","last_became_peered":"2024-09-10T21:07:08.988990+0000","last_unstale":"2024-09-10T21:07:08.993127+0000","last_undegraded":"2024-09-10T21:07:08.993127+0000","last_fullsized":"2024-09-10T21:07:08.993127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:06.536654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.013538+0000","last_change":"2024-09-10T21:07:07.982303+0000","last_active":"2024-09-10T21:07:09.013538+0000","last_peered":"2024-09-10T21:07:09.013538+0000","last_clean":"2024-09-10T21:07:09.013538+0000","last_became_active":"2024-09-10T21:07:07.982051+0000","last_became_peered":"2024-09-10T21:07:07.982051+0000","last_unstale":"2024-09-10T21:07:09.013538+0000","last_undegraded":"2024-09-10T21:07:09.013538+0000","last_fullsized":"2024-09-10T21:07:09.013538+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:36.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982710+0000","last_change":"2024-09-10T21:07:08.989864+0000","last_active":"2024-09-10T21:07:09.982710+0000","last_peered":"2024-09-10T21:07:09.982710+0000","last_clean":"2024-09-10T21:07:09.982710+0000","last_became_active":"2024-09-10T21:07:08.989615+0000","last_became_peered":"2024-09-10T21:07:08.989615+0000","last_unstale":"2024-09-10T21:07:09.982710+0000","last_undegraded":"2024-09-10T21:07:09.982710+0000","last_fullsized":"2024-09-10T21:07:09.982710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982909+0000","last_change":"2024-09-10T21:07:07.975121+0000","last_active":"2024-09-10T21:07:09.982909+0000","last_peered":"2024-09-10T21:07:09.982909+0000","last_clean":"2024-09-10T21:07:09.982909+0000","last_became_active":"2024-09-10T21:07:07.974854+0000","last_became_peered":"2024-09-10T21:07:07.974854+0000","last_unstale":"2024-09-10T21:07:09.982909+0000","last_undegraded":"2024-09-10T21:07:09.982909+0000","last_fullsized":"2024-09-10T21:07:09.982909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991864+0000","last_change":"2024-09-10T21:07:08.984081+0000","last_active":"2024-09-10T21:07:08.991864+0000","last_peered":"2024-09-10T21:07:08.991864+0000","last_clean":"2024-09-10T21:07:08.991864+0000","last_became_active":"2024-09-10T21:07:08.983081+0000","last_became_peered":"2024-09-10T21:07:08.983081+0000","last_unstale":"2024-09-10T21:07:08.991864+0000","last_undegraded":"2024-09-10T21:07:08.991864+0000","last_fullsized":"2024-09-10T21:07:08.991864+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:14.488707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006307+0000","last_change":"2024-09-10T21:07:07.974937+0000","last_active":"2024-09-10T21:07:09.006307+0000","last_peered":"2024-09-10T21:07:09.006307+0000","last_clean":"2024-09-10T21:07:09.006307+0000","last_became_active":"2024-09-10T21:07:07.973491+0000","last_became_peered":"2024-09-10T21:07:07.973491+0000","last_unstale":"2024-09-10T21:07:09.006307+0000","last_undegraded":"2024-09-10T21:07:09.006307+0000","last_fullsized":"2024-09-10T21:07:09.006307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:28.408739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982984+0000","last_change":"2024-09-10T21:07:08.989505+0000","last_active":"2024-09-10T21:07:09.982984+0000","last_peered":"2024-09-10T21:07:09.982984+0000","last_clean":"2024-09-10T21:07:09.982984+0000","last_became_active":"2024-09-10T21:07:08.988284+0000","last_became_peered":"2024-09-10T21:07:08.988284+0000","last_unstale":"2024-09-10T21:07:09.982984+0000","last_undegraded":"2024-09-10T21:07:09.982984+0000","last_fullsized":"2024-09-10T21:07:09.982984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009024+0000","last_change":"2024-09-10T21:07:07.983144+0000","last_active":"2024-09-10T21:07:09.009024+0000","last_peered":"2024-09-10T21:07:09.009024+0000","last_clean":"2024-09-10T21:07:09.009024+0000","last_became_active":"2024-09-10T21:07:07.982903+0000","last_became_peered":"2024-09-10T21:07:07.982903+0000","last_unstale":"2024-09-10T21:07:09.009024+0000","last_undegraded":"2024-09-10T21:07:09.009024+0000","last_fullsized":"2024-09-10T21:07:09.009024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008357+0000","last_change":"2024-09-10T21:07:08.997979+0000","last_active":"2024-09-10T21:07:09.008357+0000","last_peered":"2024-09-10T21:07:09.008357+0000","last_clean":"2024-09-10T21:07:09.008357+0000","last_became_active":"2024-09-10T21:07:08.994323+0000","last_became_peered":"2024-09-10T21:07:08.994323+0000","last_unstale":"2024-09-10T21:07:09.008357+0000","last_undegraded":"2024-09-10T21:07:09.008357+0000","last_fullsized":"2024-09-10T21:07:09.008357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.005693+0000","last_change":"2024-09-10T21:07:07.980708+0000","last_active":"2024-09-10T21:07:09.005693+0000","last_peered":"2024-09-10T21:07:09.005693+0000","last_clean":"2024-09-10T21:07:09.005693+0000","last_became_active":"2024-09-10T21:07:07.980440+0000","last_became_peered":"2024-09-10T21:07:07.980440+0000","last_unstale":"2024-09-10T21:07:09.005693+0000","last_undegraded":"2024-09-10T21:07:09.005693+0000","last_fullsized":"2024-09-10T21:07:09.005693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:25.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988142+0000","last_change":"2024-09-10T21:07:08.997562+0000","last_active":"2024-09-10T21:07:09.988142+0000","last_peered":"2024-09-10T21:07:09.988142+0000","last_clean":"2024-09-10T21:07:09.988142+0000","last_became_active":"2024-09-10T21:07:08.997293+0000","last_became_peered":"2024-09-10T21:07:08.997293+0000","last_unstale":"2024-09-10T21:07:09.988142+0000","last_undegraded":"2024-09-10T21:07:09.988142+0000","last_fullsized":"2024-09-10T21:07:09.988142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982325+0000","last_change":"2024-09-10T21:07:07.977927+0000","last_active":"2024-09-10T21:07:09.982325+0000","last_peered":"2024-09-10T21:07:09.982325+0000","last_clean":"2024-09-10T21:07:09.982325+0000","last_became_active":"2024-09-10T21:07:07.976343+0000","last_became_peered":"2024-09-10T21:07:07.976343+0000","last_unstale":"2024-09-10T21:07:09.982325+0000","last_undegraded":"2024-09-10T21:07:09.982325+0000","last_fullsized":"2024-09-10T21:07:09.982325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:13.035700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.984081+0000","last_change":"2024-09-10T21:07:08.981362+0000","last_active":"2024-09-10T21:07:08.984081+0000","last_peered":"2024-09-10T21:07:08.984081+0000","last_clean":"2024-09-10T21:07:08.984081+0000","last_became_active":"2024-09-10T21:07:08.981095+0000","last_became_peered":"2024-09-10T21:07:08.981095+0000","last_unstale":"2024-09-10T21:07:08.984081+0000","last_undegraded":"2024-09-10T21:07:08.984081+0000","last_fullsized":"2024-09-10T21:07:08.984081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:24.429348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.979079+0000","last_change":"2024-09-10T21:07:07.974482+0000","last_active":"2024-09-10T21:07:08.979079+0000","last_peered":"2024-09-10T21:07:08.979079+0000","last_clean":"2024-09-10T21:07:08.979079+0000","last_became_active":"2024-09-10T21:07:07.974215+0000","last_became_peered":"2024-09-10T21:07:07.974215+0000","last_unstale":"2024-09-10T21:07:08.979079+0000","last_undegraded":"2024-09-10T21:07:08.979079+0000","last_fullsized":"2024-09-10T21:07:08.979079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:07.774238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982188+0000","last_change":"2024-09-10T21:07:08.990378+0000","last_active":"2024-09-10T21:07:09.982188+0000","last_peered":"2024-09-10T21:07:09.982188+0000","last_clean":"2024-09-10T21:07:09.982188+0000","last_became_active":"2024-09-10T21:07:08.990072+0000","last_became_peered":"2024-09-10T21:07:08.990072+0000","last_unstale":"2024-09-10T21:07:09.982188+0000","last_undegraded":"2024-09-10T21:07:09.982188+0000","last_fullsized":"2024-09-10T21:07:09.982188+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:58.604705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982138+0000","last_change":"2024-09-10T21:07:07.975095+0000","last_active":"2024-09-10T21:07:09.982138+0000","last_peered":"2024-09-10T21:07:09.982138+0000","last_clean":"2024-09-10T21:07:09.982138+0000","last_became_active":"2024-09-10T21:07:07.974845+0000","last_became_peered":"2024-09-10T21:07:07.974845+0000","last_unstale":"2024-09-10T21:07:09.982138+0000","last_undegraded":"2024-09-10T21:07:09.982138+0000","last_fullsized":"2024-09-10T21:07:09.982138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.956032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.985729+0000","last_change":"2024-09-10T21:07:08.982133+0000","last_active":"2024-09-10T21:07:08.985729+0000","last_peered":"2024-09-10T21:07:08.985729+0000","last_clean":"2024-09-10T21:07:08.985729+0000","last_became_active":"2024-09-10T21:07:08.981870+0000","last_became_peered":"2024-09-10T21:07:08.981870+0000","last_unstale":"2024-09-10T21:07:08.985729+0000","last_undegraded":"2024-09-10T21:07:08.985729+0000","last_fullsized":"2024-09-10T21:07:08.985729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.978790+0000","last_change":"2024-09-10T21:07:07.980009+0000","last_active":"2024-09-10T21:07:08.978790+0000","last_peered":"2024-09-10T21:07:08.978790+0000","last_clean":"2024-09-10T21:07:08.978790+0000","last_became_active":"2024-09-10T21:07:07.979733+0000","last_became_peered":"2024-09-10T21:07:07.979733+0000","last_unstale":"2024-09-10T21:07:08.978790+0000","last_undegraded":"2024-09-10T21:07:08.978790+0000","last_fullsized":"2024-09-10T21:07:08.978790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:34.698327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.001980+0000","last_change":"2024-09-10T21:07:08.986736+0000","last_active":"2024-09-10T21:07:09.001980+0000","last_peered":"2024-09-10T21:07:09.001980+0000","last_clean":"2024-09-10T21:07:09.001980+0000","last_became_active":"2024-09-10T21:07:08.986446+0000","last_became_peered":"2024-09-10T21:07:08.986446+0000","last_unstale":"2024-09-10T21:07:09.001980+0000","last_undegraded":"2024-09-10T21:07:09.001980+0000","last_fullsized":"2024-09-10T21:07:09.001980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:35.371632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.970689+0000","last_change":"2024-09-10T21:07:07.976156+0000","last_active":"2024-09-10T21:07:08.970689+0000","last_peered":"2024-09-10T21:07:08.970689+0000","last_clean":"2024-09-10T21:07:08.970689+0000","last_became_active":"2024-09-10T21:07:07.975900+0000","last_became_peered":"2024-09-10T21:07:07.975900+0000","last_unstale":"2024-09-10T21:07:08.970689+0000","last_undegraded":"2024-09-10T21:07:08.970689+0000","last_fullsized":"2024-09-10T21:07:08.970689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:58.074407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.010629+0000","last_change":"2024-09-10T21:07:09.002670+0000","last_active":"2024-09-10T21:07:09.010629+0000","last_peered":"2024-09-10T21:07:09.010629+0000","last_clean":"2024-09-10T21:07:09.010629+0000","last_became_active":"2024-09-10T21:07:09.002402+0000","last_became_peered":"2024-09-10T21:07:09.002402+0000","last_unstale":"2024-09-10T21:07:09.010629+0000","last_undegraded":"2024-09-10T21:07:09.010629+0000","last_fullsized":"2024-09-10T21:07:09.010629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:37.617366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.010961+0000","last_change":"2024-09-10T21:07:07.980159+0000","last_active":"2024-09-10T21:07:09.010961+0000","last_peered":"2024-09-10T21:07:09.010961+0000","last_clean":"2024-09-10T21:07:09.010961+0000","last_became_active":"2024-09-10T21:07:07.977260+0000","last_became_peered":"2024-09-10T21:07:07.977260+0000","last_unstale":"2024-09-10T21:07:09.010961+0000","last_undegraded":"2024-09-10T21:07:09.010961+0000","last_fullsized":"2024-09-10T21:07:09.010961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:02.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982844+0000","last_change":"2024-09-10T21:07:08.992058+0000","last_active":"2024-09-10T21:07:09.982844+0000","last_peered":"2024-09-10T21:07:09.982844+0000","last_clean":"2024-09-10T21:07:09.982844+0000","last_became_active":"2024-09-10T21:07:08.991804+0000","last_became_peered":"2024-09-10T21:07:08.991804+0000","last_unstale":"2024-09-10T21:07:09.982844+0000","last_undegraded":"2024-09-10T21:07:09.982844+0000","last_fullsized":"2024-09-10T21:07:09.982844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.014061+0000","last_change":"2024-09-10T21:07:07.979647+0000","last_active":"2024-09-10T21:07:09.014061+0000","last_peered":"2024-09-10T21:07:09.014061+0000","last_clean":"2024-09-10T21:07:09.014061+0000","last_became_active":"2024-09-10T21:07:07.979160+0000","last_became_peered":"2024-09-10T21:07:07.979160+0000","last_unstale":"2024-09-10T21:07:09.014061+0000","last_undegraded":"2024-09-10T21:07:09.014061+0000","last_fullsized":"2024-09-10T21:07:09.014061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:57.596670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.988404+0000","last_change":"2024-09-10T21:07:08.984593+0000","last_active":"2024-09-10T21:07:08.988404+0000","last_peered":"2024-09-10T21:07:08.988404+0000","last_clean":"2024-09-10T21:07:08.988404+0000","last_became_active":"2024-09-10T21:07:08.983212+0000","last_became_peered":"2024-09-10T21:07:08.983212+0000","last_unstale":"2024-09-10T21:07:08.988404+0000","last_undegraded":"2024-09-10T21:07:08.988404+0000","last_fullsized":"2024-09-10T21:07:08.988404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006343+0000","last_change":"2024-09-10T21:07:07.975372+0000","last_active":"2024-09-10T21:07:09.006343+0000","last_peered":"2024-09-10T21:07:09.006343+0000","last_clean":"2024-09-10T21:07:09.006343+0000","last_became_active":"2024-09-10T21:07:07.972536+0000","last_became_peered":"2024-09-10T21:07:07.972536+0000","last_unstale":"2024-09-10T21:07:09.006343+0000","last_undegraded":"2024-09-10T21:07:09.006343+0000","last_fullsized":"2024-09-10T21:07:09.006343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982321+0000","last_change":"2024-09-10T21:07:08.996216+0000","last_active":"2024-09-10T21:07:09.982321+0000","last_peered":"2024-09-10T21:07:09.982321+0000","last_clean":"2024-09-10T21:07:09.982321+0000","last_became_active":"2024-09-10T21:07:08.995845+0000","last_became_peered":"2024-09-10T21:07:08.995845+0000","last_unstale":"2024-09-10T21:07:09.982321+0000","last_undegraded":"2024-09-10T21:07:09.982321+0000","last_fullsized":"2024-09-10T21:07:09.982321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:08.782273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981739+0000","last_change":"2024-09-10T21:07:07.974580+0000","last_active":"2024-09-10T21:07:09.981739+0000","last_peered":"2024-09-10T21:07:09.981739+0000","last_clean":"2024-09-10T21:07:09.981739+0000","last_became_active":"2024-09-10T21:07:07.974287+0000","last_became_peered":"2024-09-10T21:07:07.974287+0000","last_unstale":"2024-09-10T21:07:09.981739+0000","last_undegraded":"2024-09-10T21:07:09.981739+0000","last_fullsized":"2024-09-10T21:07:09.981739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:43.257928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988494+0000","last_change":"2024-09-10T21:07:08.990713+0000","last_active":"2024-09-10T21:07:09.988494+0000","last_peered":"2024-09-10T21:07:09.988494+0000","last_clean":"2024-09-10T21:07:09.988494+0000","last_became_active":"2024-09-10T21:07:08.990447+0000","last_became_peered":"2024-09-10T21:07:08.990447+0000","last_unstale":"2024-09-10T21:07:09.988494+0000","last_undegraded":"2024-09-10T21:07:09.988494+0000","last_fullsized":"2024-09-10T21:07:09.988494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.969223+0000","last_change":"2024-09-10T21:07:07.982710+0000","last_active":"2024-09-10T21:07:08.969223+0000","last_peered":"2024-09-10T21:07:08.969223+0000","last_clean":"2024-09-10T21:07:08.969223+0000","last_became_active":"2024-09-10T21:07:07.982189+0000","last_became_peered":"2024-09-10T21:07:07.982189+0000","last_unstale":"2024-09-10T21:07:08.969223+0000","last_undegraded":"2024-09-10T21:07:08.969223+0000","last_fullsized":"2024-09-10T21:07:08.969223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:21.481889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983543+0000","last_change":"2024-09-10T21:07:09.003185+0000","last_active":"2024-09-10T21:07:09.983543+0000","last_peered":"2024-09-10T21:07:09.983543+0000","last_clean":"2024-09-10T21:07:09.983543+0000","last_became_active":"2024-09-10T21:07:09.002210+0000","last_became_peered":"2024-09-10T21:07:09.002210+0000","last_unstale":"2024-09-10T21:07:09.983543+0000","last_undegraded":"2024-09-10T21:07:09.983543+0000","last_fullsized":"2024-09-10T21:07:09.983543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.014308+0000","last_change":"2024-09-10T21:07:07.977268+0000","last_active":"2024-09-10T21:07:09.014308+0000","last_peered":"2024-09-10T21:07:09.014308+0000","last_clean":"2024-09-10T21:07:09.014308+0000","last_became_active":"2024-09-10T21:07:07.977016+0000","last_became_peered":"2024-09-10T21:07:07.977016+0000","last_unstale":"2024-09-10T21:07:09.014308+0000","last_undegraded":"2024-09-10T21:07:09.014308+0000","last_fullsized":"2024-09-10T21:07:09.014308+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982259+0000","last_change":"2024-09-10T21:07:08.996569+0000","last_active":"2024-09-10T21:07:09.982259+0000","last_peered":"2024-09-10T21:07:09.982259+0000","last_clean":"2024-09-10T21:07:09.982259+0000","last_became_active":"2024-09-10T21:07:08.996285+0000","last_became_peered":"2024-09-10T21:07:08.996285+0000","last_unstale":"2024-09-10T21:07:09.982259+0000","last_undegraded":"2024-09-10T21:07:09.982259+0000","last_fullsized":"2024-09-10T21:07:09.982259+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:35.706362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982755+0000","last_change":"2024-09-10T21:07:07.975307+0000","last_active":"2024-09-10T21:07:09.982755+0000","last_peered":"2024-09-10T21:07:09.982755+0000","last_clean":"2024-09-10T21:07:09.982755+0000","last_became_active":"2024-09-10T21:07:07.975034+0000","last_became_peered":"2024-09-10T21:07:07.975034+0000","last_unstale":"2024-09-10T21:07:09.982755+0000","last_undegraded":"2024-09-10T21:07:09.982755+0000","last_fullsized":"2024-09-10T21:07:09.982755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:59.494549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982671+0000","last_change":"2024-09-10T21:07:08.987536+0000","last_active":"2024-09-10T21:07:09.982671+0000","last_peered":"2024-09-10T21:07:09.982671+0000","last_clean":"2024-09-10T21:07:09.982671+0000","last_became_active":"2024-09-10T21:07:08.987218+0000","last_became_peered":"2024-09-10T21:07:08.987218+0000","last_unstale":"2024-09-10T21:07:09.982671+0000","last_undegraded":"2024-09-10T21:07:09.982671+0000","last_fullsized":"2024-09-10T21:07:09.982671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009907+0000","last_change":"2024-09-10T21:07:07.975529+0000","last_active":"2024-09-10T21:07:09.009907+0000","last_peered":"2024-09-10T21:07:09.009907+0000","last_clean":"2024-09-10T21:07:09.009907+0000","last_became_active":"2024-09-10T21:07:07.974601+0000","last_became_peered":"2024-09-10T21:07:07.974601+0000","last_unstale":"2024-09-10T21:07:09.009907+0000","last_undegraded":"2024-09-10T21:07:09.009907+0000","last_fullsized":"2024-09-10T21:07:09.009907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:15.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982837+0000","last_change":"2024-09-10T21:07:08.994668+0000","last_active":"2024-09-10T21:07:09.982837+0000","last_peered":"2024-09-10T21:07:09.982837+0000","last_clean":"2024-09-10T21:07:09.982837+0000","last_became_active":"2024-09-10T21:07:08.994384+0000","last_became_peered":"2024-09-10T21:07:08.994384+0000","last_unstale":"2024-09-10T21:07:09.982837+0000","last_undegraded":"2024-09-10T21:07:09.982837+0000","last_fullsized":"2024-09-10T21:07:09.982837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:14.061765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983445+0000","last_change":"2024-09-10T21:07:07.984389+0000","last_active":"2024-09-10T21:07:09.983445+0000","last_peered":"2024-09-10T21:07:09.983445+0000","last_clean":"2024-09-10T21:07:09.983445+0000","last_became_active":"2024-09-10T21:07:07.983958+0000","last_became_peered":"2024-09-10T21:07:07.983958+0000","last_unstale":"2024-09-10T21:07:09.983445+0000","last_undegraded":"2024-09-10T21:07:09.983445+0000","last_fullsized":"2024-09-10T21:07:09.983445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:38.916517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-10T21:07:06.963205+0000","last_change":"2024-09-10T21:07:06.963205+0000","last_active":"2024-09-10T21:07:06.943662+0000","last_peered":"2024-09-10T21:07:06.943662+0000","last_clean":"2024-09-10T21:07:06.943662+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:06.963205+0000","last_undegraded":"2024-09-10T21:07:06.963205+0000","last_fullsized":"2024-09-10T21:07:06.963205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991928+0000","last_change":"2024-09-10T21:07:08.985488+0000","last_active":"2024-09-10T21:07:08.991928+0000","last_peered":"2024-09-10T21:07:08.991928+0000","last_clean":"2024-09-10T21:07:08.991928+0000","last_became_active":"2024-09-10T21:07:08.985240+0000","last_became_peered":"2024-09-10T21:07:08.985240+0000","last_unstale":"2024-09-10T21:07:08.991928+0000","last_undegraded":"2024-09-10T21:07:08.991928+0000","last_fullsized":"2024-09-10T21:07:08.991928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:21.219197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-10T21:07:06.963180+0000","last_change":"2024-09-10T21:07:06.963180+0000","last_active":"2024-09-10T21:07:06.943662+0000","last_peered":"2024-09-10T21:07:06.943662+0000","last_clean":"2024-09-10T21:07:06.943662+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:06.963180+0000","last_undegraded":"2024-09-10T21:07:06.963180+0000","last_fullsized":"2024-09-10T21:07:06.963180+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006712+0000","last_change":"2024-09-10T21:07:08.994822+0000","last_active":"2024-09-10T21:07:09.006712+0000","last_peered":"2024-09-10T21:07:09.006712+0000","last_clean":"2024-09-10T21:07:09.006712+0000","last_became_active":"2024-09-10T21:07:08.994580+0000","last_became_peered":"2024-09-10T21:07:08.994580+0000","last_unstale":"2024-09-10T21:07:09.006712+0000","last_undegraded":"2024-09-10T21:07:09.006712+0000","last_fullsized":"2024-09-10T21:07:09.006712+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981844+0000","last_change":"2024-09-10T21:07:07.970920+0000","last_active":"2024-09-10T21:07:09.981844+0000","last_peered":"2024-09-10T21:07:09.981844+0000","last_clean":"2024-09-10T21:07:09.981844+0000","last_became_active":"2024-09-10T21:07:07.970301+0000","last_became_peered":"2024-09-10T21:07:07.970301+0000","last_unstale":"2024-09-10T21:07:09.981844+0000","last_undegraded":"2024-09-10T21:07:09.981844+0000","last_fullsized":"2024-09-10T21:07:09.981844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988171+0000","last_change":"2024-09-10T21:07:08.990744+0000","last_active":"2024-09-10T21:07:09.988171+0000","last_peered":"2024-09-10T21:07:09.988171+0000","last_clean":"2024-09-10T21:07:09.988171+0000","last_became_active":"2024-09-10T21:07:08.989163+0000","last_became_peered":"2024-09-10T21:07:08.989163+0000","last_unstale":"2024-09-10T21:07:09.988171+0000","last_undegraded":"2024-09-10T21:07:09.988171+0000","last_fullsized":"2024-09-10T21:07:09.988171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982544+0000","last_change":"2024-09-10T21:07:07.974215+0000","last_active":"2024-09-10T21:07:09.982544+0000","last_peered":"2024-09-10T21:07:09.982544+0000","last_clean":"2024-09-10T21:07:09.982544+0000","last_became_active":"2024-09-10T21:07:07.973960+0000","last_became_peered":"2024-09-10T21:07:07.973960+0000","last_unstale":"2024-09-10T21:07:09.982544+0000","last_undegraded":"2024-09-10T21:07:09.982544+0000","last_fullsized":"2024-09-10T21:07:09.982544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.040936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009159+0000","last_change":"2024-09-10T21:07:09.004117+0000","last_active":"2024-09-10T21:07:09.009159+0000","last_peered":"2024-09-10T21:07:09.009159+0000","last_clean":"2024-09-10T21:07:09.009159+0000","last_became_active":"2024-09-10T21:07:09.003435+0000","last_became_peered":"2024-09-10T21:07:09.003435+0000","last_unstale":"2024-09-10T21:07:09.009159+0000","last_undegraded":"2024-09-10T21:07:09.009159+0000","last_fullsized":"2024-09-10T21:07:09.009159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981579+0000","last_change":"2024-09-10T21:07:07.975653+0000","last_active":"2024-09-10T21:07:09.981579+0000","last_peered":"2024-09-10T21:07:09.981579+0000","last_clean":"2024-09-10T21:07:09.981579+0000","last_became_active":"2024-09-10T21:07:07.975383+0000","last_became_peered":"2024-09-10T21:07:07.975383+0000","last_unstale":"2024-09-10T21:07:09.981579+0000","last_undegraded":"2024-09-10T21:07:09.981579+0000","last_fullsized":"2024-09-10T21:07:09.981579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:24.484277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983577+0000","last_change":"2024-09-10T21:07:09.003571+0000","last_active":"2024-09-10T21:07:09.983577+0000","last_peered":"2024-09-10T21:07:09.983577+0000","last_clean":"2024-09-10T21:07:09.983577+0000","last_became_active":"2024-09-10T21:07:09.003282+0000","last_became_peered":"2024-09-10T21:07:09.003282+0000","last_unstale":"2024-09-10T21:07:09.983577+0000","last_undegraded":"2024-09-10T21:07:09.983577+0000","last_fullsized":"2024-09-10T21:07:09.983577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.004958+0000","last_change":"2024-09-10T21:07:07.982369+0000","last_active":"2024-09-10T21:07:09.004958+0000","last_peered":"2024-09-10T21:07:09.004958+0000","last_clean":"2024-09-10T21:07:09.004958+0000","last_became_active":"2024-09-10T21:07:07.982077+0000","last_became_peered":"2024-09-10T21:07:07.982077+0000","last_unstale":"2024-09-10T21:07:09.004958+0000","last_undegraded":"2024-09-10T21:07:09.004958+0000","last_fullsized":"2024-09-10T21:07:09.004958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:40.539770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988694+0000","last_change":"2024-09-10T21:07:08.989455+0000","last_active":"2024-09-10T21:07:09.988694+0000","last_peered":"2024-09-10T21:07:09.988694+0000","last_clean":"2024-09-10T21:07:09.988694+0000","last_became_active":"2024-09-10T21:07:08.989206+0000","last_became_peered":"2024-09-10T21:07:08.989206+0000","last_unstale":"2024-09-10T21:07:09.988694+0000","last_undegraded":"2024-09-10T21:07:09.988694+0000","last_fullsized":"2024-09-10T21:07:09.988694+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.987453+0000","last_change":"2024-09-10T21:07:07.984174+0000","last_active":"2024-09-10T21:07:09.987453+0000","last_peered":"2024-09-10T21:07:09.987453+0000","last_clean":"2024-09-10T21:07:09.987453+0000","last_became_active":"2024-09-10T21:07:07.983898+0000","last_became_peered":"2024-09-10T21:07:07.983898+0000","last_unstale":"2024-09-10T21:07:09.987453+0000","last_undegraded":"2024-09-10T21:07:09.987453+0000","last_fullsized":"2024-09-10T21:07:09.987453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T21:07:07.951697+0000","last_change":"2024-09-10T21:07:07.951697+0000","last_active":"2024-09-10T21:07:07.951697+0000","last_peered":"2024-09-10T21:07:07.951697+0000","last_clean":"2024-09-10T21:07:07.951697+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T21:07:07.951697+0000","last_undegraded":"2024-09-10T21:07:07.951697+0000","last_fullsized":"2024-09-10T21:07:07.951697+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983503+0000","last_change":"2024-09-10T21:07:07.982520+0000","last_active":"2024-09-10T21:07:09.983503+0000","last_peered":"2024-09-10T21:07:09.983503+0000","last_clean":"2024-09-10T21:07:09.983503+0000","last_became_active":"2024-09-10T21:07:07.982215+0000","last_became_peered":"2024-09-10T21:07:07.982215+0000","last_unstale":"2024-09-10T21:07:09.983503+0000","last_undegraded":"2024-09-10T21:07:09.983503+0000","last_fullsized":"2024-09-10T21:07:09.983503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:38.024808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982590+0000","last_change":"2024-09-10T21:07:09.000771+0000","last_active":"2024-09-10T21:07:09.982590+0000","last_peered":"2024-09-10T21:07:09.982590+0000","last_clean":"2024-09-10T21:07:09.982590+0000","last_became_active":"2024-09-10T21:07:09.000225+0000","last_became_peered":"2024-09-10T21:07:09.000225+0000","last_unstale":"2024-09-10T21:07:09.982590+0000","last_undegraded":"2024-09-10T21:07:09.982590+0000","last_fullsized":"2024-09-10T21:07:09.982590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.975892+0000","last_change":"2024-09-10T21:07:07.972550+0000","last_active":"2024-09-10T21:07:08.975892+0000","last_peered":"2024-09-10T21:07:08.975892+0000","last_clean":"2024-09-10T21:07:08.975892+0000","last_became_active":"2024-09-10T21:07:07.972258+0000","last_became_peered":"2024-09-10T21:07:07.972258+0000","last_unstale":"2024-09-10T21:07:08.975892+0000","last_undegraded":"2024-09-10T21:07:08.975892+0000","last_fullsized":"2024-09-10T21:07:08.975892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:54.175968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981812+0000","last_change":"2024-09-10T21:07:08.993085+0000","last_active":"2024-09-10T21:07:09.981812+0000","last_peered":"2024-09-10T21:07:09.981812+0000","last_clean":"2024-09-10T21:07:09.981812+0000","last_became_active":"2024-09-10T21:07:08.992693+0000","last_became_peered":"2024-09-10T21:07:08.992693+0000","last_unstale":"2024-09-10T21:07:09.981812+0000","last_undegraded":"2024-09-10T21:07:09.981812+0000","last_fullsized":"2024-09-10T21:07:09.981812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:29.416774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988406+0000","last_change":"2024-09-10T21:07:07.984281+0000","last_active":"2024-09-10T21:07:09.988406+0000","last_peered":"2024-09-10T21:07:09.988406+0000","last_clean":"2024-09-10T21:07:09.988406+0000","last_became_active":"2024-09-10T21:07:07.983954+0000","last_became_peered":"2024-09-10T21:07:07.983954+0000","last_unstale":"2024-09-10T21:07:09.988406+0000","last_undegraded":"2024-09-10T21:07:09.988406+0000","last_fullsized":"2024-09-10T21:07:09.988406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:15.341376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.989535+0000","last_change":"2024-09-10T21:07:08.982222+0000","last_active":"2024-09-10T21:07:08.989535+0000","last_peered":"2024-09-10T21:07:08.989535+0000","last_clean":"2024-09-10T21:07:08.989535+0000","last_became_active":"2024-09-10T21:07:08.981942+0000","last_became_peered":"2024-09-10T21:07:08.981942+0000","last_unstale":"2024-09-10T21:07:08.989535+0000","last_undegraded":"2024-09-10T21:07:08.989535+0000","last_fullsized":"2024-09-10T21:07:08.989535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:18.777246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.969247+0000","last_change":"2024-09-10T21:07:07.982359+0000","last_active":"2024-09-10T21:07:08.969247+0000","last_peered":"2024-09-10T21:07:08.969247+0000","last_clean":"2024-09-10T21:07:08.969247+0000","last_became_active":"2024-09-10T21:07:07.982087+0000","last_became_peered":"2024-09-10T21:07:07.982087+0000","last_unstale":"2024-09-10T21:07:08.969247+0000","last_undegraded":"2024-09-10T21:07:08.969247+0000","last_fullsized":"2024-09-10T21:07:08.969247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:44.164885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988331+0000","last_change":"2024-09-10T21:07:08.994477+0000","last_active":"2024-09-10T21:07:09.988331+0000","last_peered":"2024-09-10T21:07:09.988331+0000","last_clean":"2024-09-10T21:07:09.988331+0000","last_became_active":"2024-09-10T21:07:08.994228+0000","last_became_peered":"2024-09-10T21:07:08.994228+0000","last_unstale":"2024-09-10T21:07:09.988331+0000","last_undegraded":"2024-09-10T21:07:09.988331+0000","last_fullsized":"2024-09-10T21:07:09.988331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.972673+0000","last_change":"2024-09-10T21:07:07.977266+0000","last_active":"2024-09-10T21:07:08.972673+0000","last_peered":"2024-09-10T21:07:08.972673+0000","last_clean":"2024-09-10T21:07:08.972673+0000","last_became_active":"2024-09-10T21:07:07.976927+0000","last_became_peered":"2024-09-10T21:07:07.976927+0000","last_unstale":"2024-09-10T21:07:08.972673+0000","last_undegraded":"2024-09-10T21:07:08.972673+0000","last_fullsized":"2024-09-10T21:07:08.972673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:04.086693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.001054+0000","last_change":"2024-09-10T21:07:08.996299+0000","last_active":"2024-09-10T21:07:09.001054+0000","last_peered":"2024-09-10T21:07:09.001054+0000","last_clean":"2024-09-10T21:07:09.001054+0000","last_became_active":"2024-09-10T21:07:08.995907+0000","last_became_peered":"2024-09-10T21:07:08.995907+0000","last_unstale":"2024-09-10T21:07:09.001054+0000","last_undegraded":"2024-09-10T21:07:09.001054+0000","last_fullsized":"2024-09-10T21:07:09.001054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:37.059713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988421+0000","last_change":"2024-09-10T21:07:07.979476+0000","last_active":"2024-09-10T21:07:09.988421+0000","last_peered":"2024-09-10T21:07:09.988421+0000","last_clean":"2024-09-10T21:07:09.988421+0000","last_became_active":"2024-09-10T21:07:07.979192+0000","last_became_peered":"2024-09-10T21:07:07.979192+0000","last_unstale":"2024-09-10T21:07:09.988421+0000","last_undegraded":"2024-09-10T21:07:09.988421+0000","last_fullsized":"2024-09-10T21:07:09.988421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:25.005206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982211+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:09.982211+0000","last_peered":"2024-09-10T21:07:09.982211+0000","last_clean":"2024-09-10T21:07:09.982211+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:09.982211+0000","last_undegraded":"2024-09-10T21:07:09.982211+0000","last_fullsized":"2024-09-10T21:07:09.982211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":195285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":193639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":195743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1064960,"data_stored":790631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":770083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:14.028 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-10T21:07:14.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T21:07:07.951697+0000', 'last_change': '2024-09-10T21:07:07.951697+0000', 'last_active': '2024-09-10T21:07:07.951697+0000', 'last_peered': '2024-09-10T21:07:07.951697+0000', 'last_clean': '2024-09-10T21:07:07.951697+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T21:07:07.951697+0000', 'last_undegraded': '2024-09-10T21:07:07.951697+0000', 'last_fullsized': '2024-09-10T21:07:07.951697+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'last_clean_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T21:07:14.029 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-10T21:07:14.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T21:07:07.951697+0000', 'last_change': '2024-09-10T21:07:07.951697+0000', 'last_active': '2024-09-10T21:07:07.951697+0000', 'last_peered': '2024-09-10T21:07:07.951697+0000', 'last_clean': '2024-09-10T21:07:07.951697+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T21:07:07.951697+0000', 'last_undegraded': '2024-09-10T21:07:07.951697+0000', 'last_fullsized': '2024-09-10T21:07:07.951697+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'last_clean_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T21:07:14.029 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-10T21:07:14.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-10T21:07:06.963205+0000', 'last_change': '2024-09-10T21:07:06.963205+0000', 'last_active': '2024-09-10T21:07:06.943662+0000', 'last_peered': '2024-09-10T21:07:06.943662+0000', 'last_clean': '2024-09-10T21:07:06.943662+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T21:07:06.963205+0000', 'last_undegraded': '2024-09-10T21:07:06.963205+0000', 'last_fullsized': '2024-09-10T21:07:06.963205+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T21:07:06.943662+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T21:07:06.943662+0000', 'last_clean_scrub_stamp': '2024-09-10T21:07:06.943662+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T21:07:14.029 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-10T21:07:14.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-10T21:07:06.963180+0000', 'last_change': '2024-09-10T21:07:06.963180+0000', 'last_active': '2024-09-10T21:07:06.943662+0000', 'last_peered': '2024-09-10T21:07:06.943662+0000', 'last_clean': '2024-09-10T21:07:06.943662+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T21:07:06.963180+0000', 'last_undegraded': '2024-09-10T21:07:06.963180+0000', 'last_fullsized': '2024-09-10T21:07:06.963180+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T21:07:06.943662+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T21:07:06.943662+0000', 'last_clean_scrub_stamp': '2024-09-10T21:07:06.943662+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T21:07:14.029 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-10T21:07:14.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T21:07:07.951697+0000', 'last_change': '2024-09-10T21:07:07.951697+0000', 'last_active': '2024-09-10T21:07:07.951697+0000', 'last_peered': '2024-09-10T21:07:07.951697+0000', 'last_clean': '2024-09-10T21:07:07.951697+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T21:07:07.951697+0000', 'last_undegraded': '2024-09-10T21:07:07.951697+0000', 'last_fullsized': '2024-09-10T21:07:07.951697+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'last_clean_scrub_stamp': '2024-09-10T21:07:07.951697+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T21:07:14.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T21:07:14.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.215+0000 7fe8f2000640 1 -- 172.21.15.100:0/3684875564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0aea30 msgr2=0x7fe8ec073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.215+0000 7fe8f2000640 1 --2- 172.21.15.100:0/3684875564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0aea30 0x7fe8ec073610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0b4df0 tx=0x7fe8e002a5f0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.215+0000 7fe8f2000640 1 -- 172.21.15.100:0/3684875564 shutdown_connections 2024-09-10T21:07:14.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.215+0000 7fe8f2000640 1 --2- 172.21.15.100:0/3684875564 >> v2:172.21.15.130:3300/0 conn(0x7fe8ec15f8f0 0x7fe8ec15fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.215+0000 7fe8f2000640 1 --2- 172.21.15.100:0/3684875564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0aea30 0x7fe8ec073610 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.215+0000 7fe8f2000640 1 -- 172.21.15.100:0/3684875564 >> 172.21.15.100:0/3684875564 conn(0x7fe8ec06d500 msgr2=0x7fe8ec0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:14.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.216+0000 7fe8f2000640 1 -- 172.21.15.100:0/3684875564 shutdown_connections 2024-09-10T21:07:14.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.216+0000 7fe8f2000640 1 -- 172.21.15.100:0/3684875564 wait complete. 2024-09-10T21:07:14.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.217+0000 7fe8f2000640 1 Processor -- start 2024-09-10T21:07:14.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.217+0000 7fe8f2000640 1 -- start start 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8f2000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8ec0aea30 0x7fe8ec1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8f2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0cec80 0x7fe8ec1f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8f2000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ec15f8f0 0x7fe8ec0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8f2000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec0aef90 con 0x7fe8ec0cec80 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8f2000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec0aee10 con 0x7fe8ec15f8f0 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8f2000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ec0cc110 con 0x7fe8ec0aea30 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0cec80 0x7fe8ec1f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0cec80 0x7fe8ec1f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32944/0 (socket says 172.21.15.100:32944) 2024-09-10T21:07:14.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.218+0000 7fe8ebe00640 1 -- 172.21.15.100:0/1540950343 learned_addr learned my addr 172.21.15.100:0/1540950343 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8f0c00640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8ec0aea30 0x7fe8ec1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8f1600640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ec15f8f0 0x7fe8ec0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8ebe00640 1 -- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8ec0aea30 msgr2=0x7fe8ec1f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8ebe00640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8ec0aea30 0x7fe8ec1f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8ebe00640 1 -- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ec15f8f0 msgr2=0x7fe8ec0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8ebe00640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ec15f8f0 0x7fe8ec0cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8ebe00640 1 -- 172.21.15.100:0/1540950343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec1f65f0 con 0x7fe8ec0cec80 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8ebe00640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0cec80 0x7fe8ec1f2bd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c500 tx=0x7fe8d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8e8c00640 1 -- 172.21.15.100:0/1540950343 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8017070 con 0x7fe8ec0cec80 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8e8c00640 1 -- 172.21.15.100:0/1540950343 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8d80035f0 con 0x7fe8ec0cec80 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8e8c00640 1 -- 172.21.15.100:0/1540950343 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8003a40 con 0x7fe8ec0cec80 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.219+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ec1f5d50 con 0x7fe8ec0cec80 2024-09-10T21:07:14.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.220+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ec1f6310 con 0x7fe8ec0cec80 2024-09-10T21:07:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.220+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ec073610 con 0x7fe8ec0cec80 2024-09-10T21:07:14.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.222+0000 7fe8e8c00640 1 -- 172.21.15.100:0/1540950343 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe8d8003be0 con 0x7fe8ec0cec80 2024-09-10T21:07:14.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.222+0000 7fe8e8c00640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe8cc077f70 0x7fe8cc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:14.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.223+0000 7fe8e8c00640 1 -- 172.21.15.100:0/1540950343 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe8d8099680 con 0x7fe8ec0cec80 2024-09-10T21:07:14.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.223+0000 7fe8f0c00640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe8cc077f70 0x7fe8cc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:14.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.224+0000 7fe8f0c00640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe8cc077f70 0x7fe8cc07a430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0033000 tx=0x7fe8e0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:14.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.227+0000 7fe8e8c00640 1 -- 172.21.15.100:0/1540950343 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe8d8062080 con 0x7fe8ec0cec80 2024-09-10T21:07:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.478+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe8ec0cd2c0 con 0x7fe8ec0cec80 2024-09-10T21:07:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.479+0000 7fe8e8c00640 1 -- 172.21.15.100:0/1540950343 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1377 (secure 0 0 0) 0x7fe8d8061980 con 0x7fe8ec0cec80 2024-09-10T21:07:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:14.484 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":92,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1726002355,"num_in_osds":8,"osd_in_since":1726002345,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"unknown","count":3},{"state_name":"creating+peering","count":2}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":226353152,"bytes_avail":772867760128,"bytes_total":773094113280,"unknown_pgs_ratio":0.030927835032343864,"inactive_pgs_ratio":0.020618556067347527,"write_bytes_sec":2492,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":18,"btime":"2024-09-10T21:07:11:987578+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5046}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-10T21:07:02.701925+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T21:07:14.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe8cc077f70 msgr2=0x7fe8cc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe8cc077f70 0x7fe8cc07a430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0033000 tx=0x7fe8e0004730 comp rx=0 tx=0).stop 2024-09-10T21:07:14.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0cec80 msgr2=0x7fe8ec1f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0cec80 0x7fe8ec1f2bd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c500 tx=0x7fe8d800c9c0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 shutdown_connections 2024-09-10T21:07:14.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe8cc077f70 0x7fe8cc07a430 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ec15f8f0 0x7fe8ec0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8ec0cec80 0x7fe8ec1f2bd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 --2- 172.21.15.100:0/1540950343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8ec0aea30 0x7fe8ec1f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 >> 172.21.15.100:0/1540950343 conn(0x7fe8ec06d500 msgr2=0x7fe8ec15cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:14.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.481+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 shutdown_connections 2024-09-10T21:07:14.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.482+0000 7fe8f2000640 1 -- 172.21.15.100:0/1540950343 wait complete. 2024-09-10T21:07:14.502 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T21:07:14.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:14.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.655+0000 7f4c57200640 1 -- 172.21.15.100:0/185557405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c5815f8f0 msgr2=0x7f4c5815fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.655+0000 7f4c57200640 1 --2- 172.21.15.100:0/185557405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c5815f8f0 0x7f4c5815fd20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4c580cc040 tx=0x7f4c5002aac0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.655+0000 7f4c57200640 1 -- 172.21.15.100:0/185557405 shutdown_connections 2024-09-10T21:07:14.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.655+0000 7f4c57200640 1 --2- 172.21.15.100:0/185557405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c5815f8f0 0x7f4c5815fd20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.655+0000 7f4c57200640 1 --2- 172.21.15.100:0/185557405 >> v2:172.21.15.130:3300/0 conn(0x7f4c580aea30 0x7f4c58073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.655+0000 7f4c57200640 1 -- 172.21.15.100:0/185557405 >> 172.21.15.100:0/185557405 conn(0x7f4c5806d500 msgr2=0x7f4c580b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:14.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.655+0000 7f4c57200640 1 -- 172.21.15.100:0/185557405 shutdown_connections 2024-09-10T21:07:14.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.655+0000 7f4c57200640 1 -- 172.21.15.100:0/185557405 wait complete. 2024-09-10T21:07:14.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.656+0000 7f4c57200640 1 Processor -- start 2024-09-10T21:07:14.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.657+0000 7f4c57200640 1 -- start start 2024-09-10T21:07:14.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.657+0000 7f4c57200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c580aea30 0x7f4c58153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:14.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.657+0000 7f4c57200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c580cec80 0x7f4c5806ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.657+0000 7f4c57200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c5815f8f0 0x7f4c581491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.657+0000 7f4c57200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5815c580 con 0x7f4c580aea30 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.657+0000 7f4c57200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c580af020 con 0x7f4c580cec80 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.657+0000 7f4c57200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4c580cc110 con 0x7f4c5815f8f0 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c580aea30 0x7f4c58153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c580aea30 0x7f4c58153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32952/0 (socket says 172.21.15.100:32952) 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 -- 172.21.15.100:0/1096191191 learned_addr learned my addr 172.21.15.100:0/1096191191 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c56800640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c5815f8f0 0x7f4c581491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55400640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c580cec80 0x7f4c5806ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 -- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c5815f8f0 msgr2=0x7f4c581491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c5815f8f0 0x7f4c581491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 -- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c580cec80 msgr2=0x7f4c5806ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c580cec80 0x7f4c5806ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 -- 172.21.15.100:0/1096191191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c58153040 con 0x7f4c580aea30 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.658+0000 7f4c55e00640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c580aea30 0x7f4c58153e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800d950 tx=0x7f4c4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.659+0000 7f4c4e000640 1 -- 172.21.15.100:0/1096191191 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48017070 con 0x7f4c580aea30 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.659+0000 7f4c4e000640 1 -- 172.21.15.100:0/1096191191 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c48009d20 con 0x7f4c580aea30 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.659+0000 7f4c4e000640 1 -- 172.21.15.100:0/1096191191 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c480106c0 con 0x7f4c580aea30 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.659+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c58153320 con 0x7f4c580aea30 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.659+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c581538e0 con 0x7f4c580aea30 2024-09-10T21:07:14.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.660+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c58073610 con 0x7f4c580aea30 2024-09-10T21:07:14.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.661+0000 7f4c4e000640 1 -- 172.21.15.100:0/1096191191 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4c48010860 con 0x7f4c580aea30 2024-09-10T21:07:14.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.662+0000 7f4c4e000640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c38077fa0 0x7f4c3807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:14.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.662+0000 7f4c4e000640 1 -- 172.21.15.100:0/1096191191 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f4c4809a380 con 0x7f4c580aea30 2024-09-10T21:07:14.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.662+0000 7f4c55400640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c38077fa0 0x7f4c3807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:14.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.663+0000 7f4c55400640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c38077fa0 0x7f4c3807a460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c580ae630 tx=0x7f4c44009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.666+0000 7f4c4e000640 1 -- 172.21.15.100:0/1096191191 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4c48062c60 con 0x7f4c580aea30 2024-09-10T21:07:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.846+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c58152df0 con 0x7f4c38077fa0 2024-09-10T21:07:14.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.850+0000 7f4c4e000640 1 -- 172.21.15.100:0/1096191191 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f4c58152df0 con 0x7f4c38077fa0 2024-09-10T21:07:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.854+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c38077fa0 msgr2=0x7f4c3807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.854+0000 7f4c57200640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c38077fa0 0x7f4c3807a460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c580ae630 tx=0x7f4c44009040 comp rx=0 tx=0).stop 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.854+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c580aea30 msgr2=0x7f4c58153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.854+0000 7f4c57200640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c580aea30 0x7f4c58153e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800d950 tx=0x7f4c4800de10 comp rx=0 tx=0).stop 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.855+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 shutdown_connections 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.855+0000 7f4c57200640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c5815f8f0 0x7f4c581491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.855+0000 7f4c57200640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c38077fa0 0x7f4c3807a460 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.855+0000 7f4c57200640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c580cec80 0x7f4c5806ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.855+0000 7f4c57200640 1 --2- 172.21.15.100:0/1096191191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c580aea30 0x7f4c58153e00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:14.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.855+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 >> 172.21.15.100:0/1096191191 conn(0x7f4c5806d500 msgr2=0x7f4c580ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:14.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.855+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 shutdown_connections 2024-09-10T21:07:14.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:14.855+0000 7f4c57200640 1 -- 172.21.15.100:0/1096191191 wait complete. 2024-09-10T21:07:14.875 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-10T21:07:14.704677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4836,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":4952064,"data_stored":2767408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.748641"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006398+0000","last_change":"2024-09-10T21:07:08.993655+0000","last_active":"2024-09-10T21:07:09.006398+0000","last_peered":"2024-09-10T21:07:09.006398+0000","last_clean":"2024-09-10T21:07:09.006398+0000","last_became_active":"2024-09-10T21:07:08.991972+0000","last_became_peered":"2024-09-10T21:07:08.991972+0000","last_unstale":"2024-09-10T21:07:09.006398+0000","last_undegraded":"2024-09-10T21:07:09.006398+0000","last_fullsized":"2024-09-10T21:07:09.006398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:42.045631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983097+0000","last_change":"2024-09-10T21:07:08.993612+0000","last_active":"2024-09-10T21:07:09.983097+0000","last_peered":"2024-09-10T21:07:09.983097+0000","last_clean":"2024-09-10T21:07:09.983097+0000","last_became_active":"2024-09-10T21:07:08.993291+0000","last_became_peered":"2024-09-10T21:07:08.993291+0000","last_unstale":"2024-09-10T21:07:09.983097+0000","last_undegraded":"2024-09-10T21:07:09.983097+0000","last_fullsized":"2024-09-10T21:07:09.983097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.998149+0000","last_change":"2024-09-10T21:07:08.986654+0000","last_active":"2024-09-10T21:07:08.998149+0000","last_peered":"2024-09-10T21:07:08.998149+0000","last_clean":"2024-09-10T21:07:08.998149+0000","last_became_active":"2024-09-10T21:07:08.986313+0000","last_became_peered":"2024-09-10T21:07:08.986313+0000","last_unstale":"2024-09-10T21:07:08.998149+0000","last_undegraded":"2024-09-10T21:07:08.998149+0000","last_fullsized":"2024-09-10T21:07:08.998149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.007251+0000","last_change":"2024-09-10T21:07:08.992089+0000","last_active":"2024-09-10T21:07:09.007251+0000","last_peered":"2024-09-10T21:07:09.007251+0000","last_clean":"2024-09-10T21:07:09.007251+0000","last_became_active":"2024-09-10T21:07:08.991795+0000","last_became_peered":"2024-09-10T21:07:08.991795+0000","last_unstale":"2024-09-10T21:07:09.007251+0000","last_undegraded":"2024-09-10T21:07:09.007251+0000","last_fullsized":"2024-09-10T21:07:09.007251+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983410+0000","last_change":"2024-09-10T21:07:09.006257+0000","last_active":"2024-09-10T21:07:09.983410+0000","last_peered":"2024-09-10T21:07:09.983410+0000","last_clean":"2024-09-10T21:07:09.983410+0000","last_became_active":"2024-09-10T21:07:09.005851+0000","last_became_peered":"2024-09-10T21:07:09.005851+0000","last_unstale":"2024-09-10T21:07:09.983410+0000","last_undegraded":"2024-09-10T21:07:09.983410+0000","last_fullsized":"2024-09-10T21:07:09.983410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981787+0000","last_change":"2024-09-10T21:07:08.985543+0000","last_active":"2024-09-10T21:07:09.981787+0000","last_peered":"2024-09-10T21:07:09.981787+0000","last_clean":"2024-09-10T21:07:09.981787+0000","last_became_active":"2024-09-10T21:07:08.981933+0000","last_became_peered":"2024-09-10T21:07:08.981933+0000","last_unstale":"2024-09-10T21:07:09.981787+0000","last_undegraded":"2024-09-10T21:07:09.981787+0000","last_fullsized":"2024-09-10T21:07:09.981787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:55.184003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982434+0000","last_change":"2024-09-10T21:07:08.991775+0000","last_active":"2024-09-10T21:07:09.982434+0000","last_peered":"2024-09-10T21:07:09.982434+0000","last_clean":"2024-09-10T21:07:09.982434+0000","last_became_active":"2024-09-10T21:07:08.991499+0000","last_became_peered":"2024-09-10T21:07:08.991499+0000","last_unstale":"2024-09-10T21:07:09.982434+0000","last_undegraded":"2024-09-10T21:07:09.982434+0000","last_fullsized":"2024-09-10T21:07:09.982434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008785+0000","last_change":"2024-09-10T21:07:09.003113+0000","last_active":"2024-09-10T21:07:09.008785+0000","last_peered":"2024-09-10T21:07:09.008785+0000","last_clean":"2024-09-10T21:07:09.008785+0000","last_became_active":"2024-09-10T21:07:09.002875+0000","last_became_peered":"2024-09-10T21:07:09.002875+0000","last_unstale":"2024-09-10T21:07:09.008785+0000","last_undegraded":"2024-09-10T21:07:09.008785+0000","last_fullsized":"2024-09-10T21:07:09.008785+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:25.364850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983824+0000","last_change":"2024-09-10T21:07:08.995695+0000","last_active":"2024-09-10T21:07:09.983824+0000","last_peered":"2024-09-10T21:07:09.983824+0000","last_clean":"2024-09-10T21:07:09.983824+0000","last_became_active":"2024-09-10T21:07:08.995450+0000","last_became_peered":"2024-09-10T21:07:08.995450+0000","last_unstale":"2024-09-10T21:07:09.983824+0000","last_undegraded":"2024-09-10T21:07:09.983824+0000","last_fullsized":"2024-09-10T21:07:09.983824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982683+0000","last_change":"2024-09-10T21:07:08.987778+0000","last_active":"2024-09-10T21:07:09.982683+0000","last_peered":"2024-09-10T21:07:09.982683+0000","last_clean":"2024-09-10T21:07:09.982683+0000","last_became_active":"2024-09-10T21:07:08.987558+0000","last_became_peered":"2024-09-10T21:07:08.987558+0000","last_unstale":"2024-09-10T21:07:09.982683+0000","last_undegraded":"2024-09-10T21:07:09.982683+0000","last_fullsized":"2024-09-10T21:07:09.982683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:26.013241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988586+0000","last_change":"2024-09-10T21:07:09.004347+0000","last_active":"2024-09-10T21:07:09.988586+0000","last_peered":"2024-09-10T21:07:09.988586+0000","last_clean":"2024-09-10T21:07:09.988586+0000","last_became_active":"2024-09-10T21:07:09.004076+0000","last_became_peered":"2024-09-10T21:07:09.004076+0000","last_unstale":"2024-09-10T21:07:09.988586+0000","last_undegraded":"2024-09-10T21:07:09.988586+0000","last_fullsized":"2024-09-10T21:07:09.988586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983673+0000","last_change":"2024-09-10T21:07:09.001468+0000","last_active":"2024-09-10T21:07:09.983673+0000","last_peered":"2024-09-10T21:07:09.983673+0000","last_clean":"2024-09-10T21:07:09.983673+0000","last_became_active":"2024-09-10T21:07:09.001207+0000","last_became_peered":"2024-09-10T21:07:09.001207+0000","last_unstale":"2024-09-10T21:07:09.983673+0000","last_undegraded":"2024-09-10T21:07:09.983673+0000","last_fullsized":"2024-09-10T21:07:09.983673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982349+0000","last_change":"2024-09-10T21:07:08.995284+0000","last_active":"2024-09-10T21:07:09.982349+0000","last_peered":"2024-09-10T21:07:09.982349+0000","last_clean":"2024-09-10T21:07:09.982349+0000","last_became_active":"2024-09-10T21:07:08.994529+0000","last_became_peered":"2024-09-10T21:07:08.994529+0000","last_unstale":"2024-09-10T21:07:09.982349+0000","last_undegraded":"2024-09-10T21:07:09.982349+0000","last_fullsized":"2024-09-10T21:07:09.982349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.002042+0000","last_change":"2024-09-10T21:07:08.988477+0000","last_active":"2024-09-10T21:07:09.002042+0000","last_peered":"2024-09-10T21:07:09.002042+0000","last_clean":"2024-09-10T21:07:09.002042+0000","last_became_active":"2024-09-10T21:07:08.988146+0000","last_became_peered":"2024-09-10T21:07:08.988146+0000","last_unstale":"2024-09-10T21:07:09.002042+0000","last_undegraded":"2024-09-10T21:07:09.002042+0000","last_fullsized":"2024-09-10T21:07:09.002042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:37.378222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.998634+0000","last_change":"2024-09-10T21:07:08.992983+0000","last_active":"2024-09-10T21:07:08.998634+0000","last_peered":"2024-09-10T21:07:08.998634+0000","last_clean":"2024-09-10T21:07:08.998634+0000","last_became_active":"2024-09-10T21:07:08.992683+0000","last_became_peered":"2024-09-10T21:07:08.992683+0000","last_unstale":"2024-09-10T21:07:08.998634+0000","last_undegraded":"2024-09-10T21:07:08.998634+0000","last_fullsized":"2024-09-10T21:07:08.998634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:35.716765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982205+0000","last_change":"2024-09-10T21:07:08.982108+0000","last_active":"2024-09-10T21:07:09.982205+0000","last_peered":"2024-09-10T21:07:09.982205+0000","last_clean":"2024-09-10T21:07:09.982205+0000","last_became_active":"2024-09-10T21:07:08.981887+0000","last_became_peered":"2024-09-10T21:07:08.981887+0000","last_unstale":"2024-09-10T21:07:09.982205+0000","last_undegraded":"2024-09-10T21:07:09.982205+0000","last_fullsized":"2024-09-10T21:07:09.982205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991780+0000","last_change":"2024-09-10T21:07:08.986295+0000","last_active":"2024-09-10T21:07:08.991780+0000","last_peered":"2024-09-10T21:07:08.991780+0000","last_clean":"2024-09-10T21:07:08.991780+0000","last_became_active":"2024-09-10T21:07:08.983589+0000","last_became_peered":"2024-09-10T21:07:08.983589+0000","last_unstale":"2024-09-10T21:07:08.991780+0000","last_undegraded":"2024-09-10T21:07:08.991780+0000","last_fullsized":"2024-09-10T21:07:08.991780+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:04.873265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991889+0000","last_change":"2024-09-10T21:07:08.987716+0000","last_active":"2024-09-10T21:07:08.991889+0000","last_peered":"2024-09-10T21:07:08.991889+0000","last_clean":"2024-09-10T21:07:08.991889+0000","last_became_active":"2024-09-10T21:07:08.986131+0000","last_became_peered":"2024-09-10T21:07:08.986131+0000","last_unstale":"2024-09-10T21:07:08.991889+0000","last_undegraded":"2024-09-10T21:07:08.991889+0000","last_fullsized":"2024-09-10T21:07:08.991889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:55.256639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.230168+0000","last_change":"2024-09-10T21:07:08.994052+0000","last_active":"2024-09-10T21:07:11.230168+0000","last_peered":"2024-09-10T21:07:11.230168+0000","last_clean":"2024-09-10T21:07:11.230168+0000","last_became_active":"2024-09-10T21:07:08.993765+0000","last_became_peered":"2024-09-10T21:07:08.993765+0000","last_unstale":"2024-09-10T21:07:11.230168+0000","last_undegraded":"2024-09-10T21:07:11.230168+0000","last_fullsized":"2024-09-10T21:07:11.230168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:48.077211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988341+0000","last_change":"2024-09-10T21:07:08.989449+0000","last_active":"2024-09-10T21:07:09.988341+0000","last_peered":"2024-09-10T21:07:09.988341+0000","last_clean":"2024-09-10T21:07:09.988341+0000","last_became_active":"2024-09-10T21:07:08.988365+0000","last_became_peered":"2024-09-10T21:07:08.988365+0000","last_unstale":"2024-09-10T21:07:09.988341+0000","last_undegraded":"2024-09-10T21:07:09.988341+0000","last_fullsized":"2024-09-10T21:07:09.988341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:15.897184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988657+0000","last_change":"2024-09-10T21:07:08.984966+0000","last_active":"2024-09-10T21:07:09.988657+0000","last_peered":"2024-09-10T21:07:09.988657+0000","last_clean":"2024-09-10T21:07:09.988657+0000","last_became_active":"2024-09-10T21:07:08.984696+0000","last_became_peered":"2024-09-10T21:07:08.984696+0000","last_unstale":"2024-09-10T21:07:09.988657+0000","last_undegraded":"2024-09-10T21:07:09.988657+0000","last_fullsized":"2024-09-10T21:07:09.988657+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:48.470274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988163+0000","last_change":"2024-09-10T21:07:08.992572+0000","last_active":"2024-09-10T21:07:09.988163+0000","last_peered":"2024-09-10T21:07:09.988163+0000","last_clean":"2024-09-10T21:07:09.988163+0000","last_became_active":"2024-09-10T21:07:08.992231+0000","last_became_peered":"2024-09-10T21:07:08.992231+0000","last_unstale":"2024-09-10T21:07:09.988163+0000","last_undegraded":"2024-09-10T21:07:09.988163+0000","last_fullsized":"2024-09-10T21:07:09.988163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.996609+0000","last_change":"2024-09-10T21:07:08.990954+0000","last_active":"2024-09-10T21:07:08.996609+0000","last_peered":"2024-09-10T21:07:08.996609+0000","last_clean":"2024-09-10T21:07:08.996609+0000","last_became_active":"2024-09-10T21:07:08.989166+0000","last_became_peered":"2024-09-10T21:07:08.989166+0000","last_unstale":"2024-09-10T21:07:08.996609+0000","last_undegraded":"2024-09-10T21:07:08.996609+0000","last_fullsized":"2024-09-10T21:07:08.996609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:48.434984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008398+0000","last_change":"2024-09-10T21:07:08.998488+0000","last_active":"2024-09-10T21:07:09.008398+0000","last_peered":"2024-09-10T21:07:09.008398+0000","last_clean":"2024-09-10T21:07:09.008398+0000","last_became_active":"2024-09-10T21:07:08.997677+0000","last_became_peered":"2024-09-10T21:07:08.997677+0000","last_unstale":"2024-09-10T21:07:09.008398+0000","last_undegraded":"2024-09-10T21:07:09.008398+0000","last_fullsized":"2024-09-10T21:07:09.008398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:06:30.641657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008530+0000","last_change":"2024-09-10T21:07:09.003139+0000","last_active":"2024-09-10T21:07:09.008530+0000","last_peered":"2024-09-10T21:07:09.008530+0000","last_clean":"2024-09-10T21:07:09.008530+0000","last_became_active":"2024-09-10T21:07:09.002972+0000","last_became_peered":"2024-09-10T21:07:09.002972+0000","last_unstale":"2024-09-10T21:07:09.008530+0000","last_undegraded":"2024-09-10T21:07:09.008530+0000","last_fullsized":"2024-09-10T21:07:09.008530+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008454+0000","last_change":"2024-09-10T21:07:08.998658+0000","last_active":"2024-09-10T21:07:09.008454+0000","last_peered":"2024-09-10T21:07:09.008454+0000","last_clean":"2024-09-10T21:07:09.008454+0000","last_became_active":"2024-09-10T21:07:08.993838+0000","last_became_peered":"2024-09-10T21:07:08.993838+0000","last_unstale":"2024-09-10T21:07:09.008454+0000","last_undegraded":"2024-09-10T21:07:09.008454+0000","last_fullsized":"2024-09-10T21:07:09.008454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988654+0000","last_change":"2024-09-10T21:07:08.997383+0000","last_active":"2024-09-10T21:07:09.988654+0000","last_peered":"2024-09-10T21:07:09.988654+0000","last_clean":"2024-09-10T21:07:09.988654+0000","last_became_active":"2024-09-10T21:07:08.997089+0000","last_became_peered":"2024-09-10T21:07:08.997089+0000","last_unstale":"2024-09-10T21:07:09.988654+0000","last_undegraded":"2024-09-10T21:07:09.988654+0000","last_fullsized":"2024-09-10T21:07:09.988654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982632+0000","last_change":"2024-09-10T21:07:08.993822+0000","last_active":"2024-09-10T21:07:09.982632+0000","last_peered":"2024-09-10T21:07:09.982632+0000","last_clean":"2024-09-10T21:07:09.982632+0000","last_became_active":"2024-09-10T21:07:08.991716+0000","last_became_peered":"2024-09-10T21:07:08.991716+0000","last_unstale":"2024-09-10T21:07:09.982632+0000","last_undegraded":"2024-09-10T21:07:09.982632+0000","last_fullsized":"2024-09-10T21:07:09.982632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993244+0000","last_change":"2024-09-10T21:07:08.988982+0000","last_active":"2024-09-10T21:07:08.993244+0000","last_peered":"2024-09-10T21:07:08.993244+0000","last_clean":"2024-09-10T21:07:08.993244+0000","last_became_active":"2024-09-10T21:07:08.988654+0000","last_became_peered":"2024-09-10T21:07:08.988654+0000","last_unstale":"2024-09-10T21:07:08.993244+0000","last_undegraded":"2024-09-10T21:07:08.993244+0000","last_fullsized":"2024-09-10T21:07:08.993244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:46.803121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993168+0000","last_change":"2024-09-10T21:07:08.989788+0000","last_active":"2024-09-10T21:07:08.993168+0000","last_peered":"2024-09-10T21:07:08.993168+0000","last_clean":"2024-09-10T21:07:08.993168+0000","last_became_active":"2024-09-10T21:07:08.988825+0000","last_became_peered":"2024-09-10T21:07:08.988825+0000","last_unstale":"2024-09-10T21:07:08.993168+0000","last_undegraded":"2024-09-10T21:07:08.993168+0000","last_fullsized":"2024-09-10T21:07:08.993168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.855818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982533+0000","last_change":"2024-09-10T21:07:08.982659+0000","last_active":"2024-09-10T21:07:09.982533+0000","last_peered":"2024-09-10T21:07:09.982533+0000","last_clean":"2024-09-10T21:07:09.982533+0000","last_became_active":"2024-09-10T21:07:08.982365+0000","last_became_peered":"2024-09-10T21:07:08.982365+0000","last_unstale":"2024-09-10T21:07:09.982533+0000","last_undegraded":"2024-09-10T21:07:09.982533+0000","last_fullsized":"2024-09-10T21:07:09.982533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008381+0000","last_change":"2024-09-10T21:07:08.998256+0000","last_active":"2024-09-10T21:07:09.008381+0000","last_peered":"2024-09-10T21:07:09.008381+0000","last_clean":"2024-09-10T21:07:09.008381+0000","last_became_active":"2024-09-10T21:07:08.994815+0000","last_became_peered":"2024-09-10T21:07:08.994815+0000","last_unstale":"2024-09-10T21:07:09.008381+0000","last_undegraded":"2024-09-10T21:07:09.008381+0000","last_fullsized":"2024-09-10T21:07:09.008381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.993127+0000","last_change":"2024-09-10T21:07:08.989239+0000","last_active":"2024-09-10T21:07:08.993127+0000","last_peered":"2024-09-10T21:07:08.993127+0000","last_clean":"2024-09-10T21:07:08.993127+0000","last_became_active":"2024-09-10T21:07:08.988990+0000","last_became_peered":"2024-09-10T21:07:08.988990+0000","last_unstale":"2024-09-10T21:07:08.993127+0000","last_undegraded":"2024-09-10T21:07:08.993127+0000","last_fullsized":"2024-09-10T21:07:08.993127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:06.536654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.013538+0000","last_change":"2024-09-10T21:07:07.982303+0000","last_active":"2024-09-10T21:07:09.013538+0000","last_peered":"2024-09-10T21:07:09.013538+0000","last_clean":"2024-09-10T21:07:09.013538+0000","last_became_active":"2024-09-10T21:07:07.982051+0000","last_became_peered":"2024-09-10T21:07:07.982051+0000","last_unstale":"2024-09-10T21:07:09.013538+0000","last_undegraded":"2024-09-10T21:07:09.013538+0000","last_fullsized":"2024-09-10T21:07:09.013538+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:36.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982710+0000","last_change":"2024-09-10T21:07:08.989864+0000","last_active":"2024-09-10T21:07:09.982710+0000","last_peered":"2024-09-10T21:07:09.982710+0000","last_clean":"2024-09-10T21:07:09.982710+0000","last_became_active":"2024-09-10T21:07:08.989615+0000","last_became_peered":"2024-09-10T21:07:08.989615+0000","last_unstale":"2024-09-10T21:07:09.982710+0000","last_undegraded":"2024-09-10T21:07:09.982710+0000","last_fullsized":"2024-09-10T21:07:09.982710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982909+0000","last_change":"2024-09-10T21:07:07.975121+0000","last_active":"2024-09-10T21:07:09.982909+0000","last_peered":"2024-09-10T21:07:09.982909+0000","last_clean":"2024-09-10T21:07:09.982909+0000","last_became_active":"2024-09-10T21:07:07.974854+0000","last_became_peered":"2024-09-10T21:07:07.974854+0000","last_unstale":"2024-09-10T21:07:09.982909+0000","last_undegraded":"2024-09-10T21:07:09.982909+0000","last_fullsized":"2024-09-10T21:07:09.982909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991864+0000","last_change":"2024-09-10T21:07:08.984081+0000","last_active":"2024-09-10T21:07:08.991864+0000","last_peered":"2024-09-10T21:07:08.991864+0000","last_clean":"2024-09-10T21:07:08.991864+0000","last_became_active":"2024-09-10T21:07:08.983081+0000","last_became_peered":"2024-09-10T21:07:08.983081+0000","last_unstale":"2024-09-10T21:07:08.991864+0000","last_undegraded":"2024-09-10T21:07:08.991864+0000","last_fullsized":"2024-09-10T21:07:08.991864+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:14.488707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006307+0000","last_change":"2024-09-10T21:07:07.974937+0000","last_active":"2024-09-10T21:07:09.006307+0000","last_peered":"2024-09-10T21:07:09.006307+0000","last_clean":"2024-09-10T21:07:09.006307+0000","last_became_active":"2024-09-10T21:07:07.973491+0000","last_became_peered":"2024-09-10T21:07:07.973491+0000","last_unstale":"2024-09-10T21:07:09.006307+0000","last_undegraded":"2024-09-10T21:07:09.006307+0000","last_fullsized":"2024-09-10T21:07:09.006307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:28.408739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982984+0000","last_change":"2024-09-10T21:07:08.989505+0000","last_active":"2024-09-10T21:07:09.982984+0000","last_peered":"2024-09-10T21:07:09.982984+0000","last_clean":"2024-09-10T21:07:09.982984+0000","last_became_active":"2024-09-10T21:07:08.988284+0000","last_became_peered":"2024-09-10T21:07:08.988284+0000","last_unstale":"2024-09-10T21:07:09.982984+0000","last_undegraded":"2024-09-10T21:07:09.982984+0000","last_fullsized":"2024-09-10T21:07:09.982984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009024+0000","last_change":"2024-09-10T21:07:07.983144+0000","last_active":"2024-09-10T21:07:09.009024+0000","last_peered":"2024-09-10T21:07:09.009024+0000","last_clean":"2024-09-10T21:07:09.009024+0000","last_became_active":"2024-09-10T21:07:07.982903+0000","last_became_peered":"2024-09-10T21:07:07.982903+0000","last_unstale":"2024-09-10T21:07:09.009024+0000","last_undegraded":"2024-09-10T21:07:09.009024+0000","last_fullsized":"2024-09-10T21:07:09.009024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.008357+0000","last_change":"2024-09-10T21:07:08.997979+0000","last_active":"2024-09-10T21:07:09.008357+0000","last_peered":"2024-09-10T21:07:09.008357+0000","last_clean":"2024-09-10T21:07:09.008357+0000","last_became_active":"2024-09-10T21:07:08.994323+0000","last_became_peered":"2024-09-10T21:07:08.994323+0000","last_unstale":"2024-09-10T21:07:09.008357+0000","last_undegraded":"2024-09-10T21:07:09.008357+0000","last_fullsized":"2024-09-10T21:07:09.008357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.005693+0000","last_change":"2024-09-10T21:07:07.980708+0000","last_active":"2024-09-10T21:07:09.005693+0000","last_peered":"2024-09-10T21:07:09.005693+0000","last_clean":"2024-09-10T21:07:09.005693+0000","last_became_active":"2024-09-10T21:07:07.980440+0000","last_became_peered":"2024-09-10T21:07:07.980440+0000","last_unstale":"2024-09-10T21:07:09.005693+0000","last_undegraded":"2024-09-10T21:07:09.005693+0000","last_fullsized":"2024-09-10T21:07:09.005693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:25.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988142+0000","last_change":"2024-09-10T21:07:08.997562+0000","last_active":"2024-09-10T21:07:09.988142+0000","last_peered":"2024-09-10T21:07:09.988142+0000","last_clean":"2024-09-10T21:07:09.988142+0000","last_became_active":"2024-09-10T21:07:08.997293+0000","last_became_peered":"2024-09-10T21:07:08.997293+0000","last_unstale":"2024-09-10T21:07:09.988142+0000","last_undegraded":"2024-09-10T21:07:09.988142+0000","last_fullsized":"2024-09-10T21:07:09.988142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982325+0000","last_change":"2024-09-10T21:07:07.977927+0000","last_active":"2024-09-10T21:07:09.982325+0000","last_peered":"2024-09-10T21:07:09.982325+0000","last_clean":"2024-09-10T21:07:09.982325+0000","last_became_active":"2024-09-10T21:07:07.976343+0000","last_became_peered":"2024-09-10T21:07:07.976343+0000","last_unstale":"2024-09-10T21:07:09.982325+0000","last_undegraded":"2024-09-10T21:07:09.982325+0000","last_fullsized":"2024-09-10T21:07:09.982325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:13.035700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.984081+0000","last_change":"2024-09-10T21:07:08.981362+0000","last_active":"2024-09-10T21:07:08.984081+0000","last_peered":"2024-09-10T21:07:08.984081+0000","last_clean":"2024-09-10T21:07:08.984081+0000","last_became_active":"2024-09-10T21:07:08.981095+0000","last_became_peered":"2024-09-10T21:07:08.981095+0000","last_unstale":"2024-09-10T21:07:08.984081+0000","last_undegraded":"2024-09-10T21:07:08.984081+0000","last_fullsized":"2024-09-10T21:07:08.984081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:24.429348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.979079+0000","last_change":"2024-09-10T21:07:07.974482+0000","last_active":"2024-09-10T21:07:08.979079+0000","last_peered":"2024-09-10T21:07:08.979079+0000","last_clean":"2024-09-10T21:07:08.979079+0000","last_became_active":"2024-09-10T21:07:07.974215+0000","last_became_peered":"2024-09-10T21:07:07.974215+0000","last_unstale":"2024-09-10T21:07:08.979079+0000","last_undegraded":"2024-09-10T21:07:08.979079+0000","last_fullsized":"2024-09-10T21:07:08.979079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:07.774238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982188+0000","last_change":"2024-09-10T21:07:08.990378+0000","last_active":"2024-09-10T21:07:09.982188+0000","last_peered":"2024-09-10T21:07:09.982188+0000","last_clean":"2024-09-10T21:07:09.982188+0000","last_became_active":"2024-09-10T21:07:08.990072+0000","last_became_peered":"2024-09-10T21:07:08.990072+0000","last_unstale":"2024-09-10T21:07:09.982188+0000","last_undegraded":"2024-09-10T21:07:09.982188+0000","last_fullsized":"2024-09-10T21:07:09.982188+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:58.604705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982138+0000","last_change":"2024-09-10T21:07:07.975095+0000","last_active":"2024-09-10T21:07:09.982138+0000","last_peered":"2024-09-10T21:07:09.982138+0000","last_clean":"2024-09-10T21:07:09.982138+0000","last_became_active":"2024-09-10T21:07:07.974845+0000","last_became_peered":"2024-09-10T21:07:07.974845+0000","last_unstale":"2024-09-10T21:07:09.982138+0000","last_undegraded":"2024-09-10T21:07:09.982138+0000","last_fullsized":"2024-09-10T21:07:09.982138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.956032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.985729+0000","last_change":"2024-09-10T21:07:08.982133+0000","last_active":"2024-09-10T21:07:08.985729+0000","last_peered":"2024-09-10T21:07:08.985729+0000","last_clean":"2024-09-10T21:07:08.985729+0000","last_became_active":"2024-09-10T21:07:08.981870+0000","last_became_peered":"2024-09-10T21:07:08.981870+0000","last_unstale":"2024-09-10T21:07:08.985729+0000","last_undegraded":"2024-09-10T21:07:08.985729+0000","last_fullsized":"2024-09-10T21:07:08.985729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.978790+0000","last_change":"2024-09-10T21:07:07.980009+0000","last_active":"2024-09-10T21:07:08.978790+0000","last_peered":"2024-09-10T21:07:08.978790+0000","last_clean":"2024-09-10T21:07:08.978790+0000","last_became_active":"2024-09-10T21:07:07.979733+0000","last_became_peered":"2024-09-10T21:07:07.979733+0000","last_unstale":"2024-09-10T21:07:08.978790+0000","last_undegraded":"2024-09-10T21:07:08.978790+0000","last_fullsized":"2024-09-10T21:07:08.978790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:34.698327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.001980+0000","last_change":"2024-09-10T21:07:08.986736+0000","last_active":"2024-09-10T21:07:09.001980+0000","last_peered":"2024-09-10T21:07:09.001980+0000","last_clean":"2024-09-10T21:07:09.001980+0000","last_became_active":"2024-09-10T21:07:08.986446+0000","last_became_peered":"2024-09-10T21:07:08.986446+0000","last_unstale":"2024-09-10T21:07:09.001980+0000","last_undegraded":"2024-09-10T21:07:09.001980+0000","last_fullsized":"2024-09-10T21:07:09.001980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:35.371632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.970689+0000","last_change":"2024-09-10T21:07:07.976156+0000","last_active":"2024-09-10T21:07:08.970689+0000","last_peered":"2024-09-10T21:07:08.970689+0000","last_clean":"2024-09-10T21:07:08.970689+0000","last_became_active":"2024-09-10T21:07:07.975900+0000","last_became_peered":"2024-09-10T21:07:07.975900+0000","last_unstale":"2024-09-10T21:07:08.970689+0000","last_undegraded":"2024-09-10T21:07:08.970689+0000","last_fullsized":"2024-09-10T21:07:08.970689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:58.074407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.010629+0000","last_change":"2024-09-10T21:07:09.002670+0000","last_active":"2024-09-10T21:07:09.010629+0000","last_peered":"2024-09-10T21:07:09.010629+0000","last_clean":"2024-09-10T21:07:09.010629+0000","last_became_active":"2024-09-10T21:07:09.002402+0000","last_became_peered":"2024-09-10T21:07:09.002402+0000","last_unstale":"2024-09-10T21:07:09.010629+0000","last_undegraded":"2024-09-10T21:07:09.010629+0000","last_fullsized":"2024-09-10T21:07:09.010629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:37.617366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.010961+0000","last_change":"2024-09-10T21:07:07.980159+0000","last_active":"2024-09-10T21:07:09.010961+0000","last_peered":"2024-09-10T21:07:09.010961+0000","last_clean":"2024-09-10T21:07:09.010961+0000","last_became_active":"2024-09-10T21:07:07.977260+0000","last_became_peered":"2024-09-10T21:07:07.977260+0000","last_unstale":"2024-09-10T21:07:09.010961+0000","last_undegraded":"2024-09-10T21:07:09.010961+0000","last_fullsized":"2024-09-10T21:07:09.010961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:02.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982844+0000","last_change":"2024-09-10T21:07:08.992058+0000","last_active":"2024-09-10T21:07:09.982844+0000","last_peered":"2024-09-10T21:07:09.982844+0000","last_clean":"2024-09-10T21:07:09.982844+0000","last_became_active":"2024-09-10T21:07:08.991804+0000","last_became_peered":"2024-09-10T21:07:08.991804+0000","last_unstale":"2024-09-10T21:07:09.982844+0000","last_undegraded":"2024-09-10T21:07:09.982844+0000","last_fullsized":"2024-09-10T21:07:09.982844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.014061+0000","last_change":"2024-09-10T21:07:07.979647+0000","last_active":"2024-09-10T21:07:09.014061+0000","last_peered":"2024-09-10T21:07:09.014061+0000","last_clean":"2024-09-10T21:07:09.014061+0000","last_became_active":"2024-09-10T21:07:07.979160+0000","last_became_peered":"2024-09-10T21:07:07.979160+0000","last_unstale":"2024-09-10T21:07:09.014061+0000","last_undegraded":"2024-09-10T21:07:09.014061+0000","last_fullsized":"2024-09-10T21:07:09.014061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:57.596670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.988404+0000","last_change":"2024-09-10T21:07:08.984593+0000","last_active":"2024-09-10T21:07:08.988404+0000","last_peered":"2024-09-10T21:07:08.988404+0000","last_clean":"2024-09-10T21:07:08.988404+0000","last_became_active":"2024-09-10T21:07:08.983212+0000","last_became_peered":"2024-09-10T21:07:08.983212+0000","last_unstale":"2024-09-10T21:07:08.988404+0000","last_undegraded":"2024-09-10T21:07:08.988404+0000","last_fullsized":"2024-09-10T21:07:08.988404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006343+0000","last_change":"2024-09-10T21:07:07.975372+0000","last_active":"2024-09-10T21:07:09.006343+0000","last_peered":"2024-09-10T21:07:09.006343+0000","last_clean":"2024-09-10T21:07:09.006343+0000","last_became_active":"2024-09-10T21:07:07.972536+0000","last_became_peered":"2024-09-10T21:07:07.972536+0000","last_unstale":"2024-09-10T21:07:09.006343+0000","last_undegraded":"2024-09-10T21:07:09.006343+0000","last_fullsized":"2024-09-10T21:07:09.006343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982321+0000","last_change":"2024-09-10T21:07:08.996216+0000","last_active":"2024-09-10T21:07:09.982321+0000","last_peered":"2024-09-10T21:07:09.982321+0000","last_clean":"2024-09-10T21:07:09.982321+0000","last_became_active":"2024-09-10T21:07:08.995845+0000","last_became_peered":"2024-09-10T21:07:08.995845+0000","last_unstale":"2024-09-10T21:07:09.982321+0000","last_undegraded":"2024-09-10T21:07:09.982321+0000","last_fullsized":"2024-09-10T21:07:09.982321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:08.782273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981739+0000","last_change":"2024-09-10T21:07:07.974580+0000","last_active":"2024-09-10T21:07:09.981739+0000","last_peered":"2024-09-10T21:07:09.981739+0000","last_clean":"2024-09-10T21:07:09.981739+0000","last_became_active":"2024-09-10T21:07:07.974287+0000","last_became_peered":"2024-09-10T21:07:07.974287+0000","last_unstale":"2024-09-10T21:07:09.981739+0000","last_undegraded":"2024-09-10T21:07:09.981739+0000","last_fullsized":"2024-09-10T21:07:09.981739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:43.257928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988494+0000","last_change":"2024-09-10T21:07:08.990713+0000","last_active":"2024-09-10T21:07:09.988494+0000","last_peered":"2024-09-10T21:07:09.988494+0000","last_clean":"2024-09-10T21:07:09.988494+0000","last_became_active":"2024-09-10T21:07:08.990447+0000","last_became_peered":"2024-09-10T21:07:08.990447+0000","last_unstale":"2024-09-10T21:07:09.988494+0000","last_undegraded":"2024-09-10T21:07:09.988494+0000","last_fullsized":"2024-09-10T21:07:09.988494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.969223+0000","last_change":"2024-09-10T21:07:07.982710+0000","last_active":"2024-09-10T21:07:08.969223+0000","last_peered":"2024-09-10T21:07:08.969223+0000","last_clean":"2024-09-10T21:07:08.969223+0000","last_became_active":"2024-09-10T21:07:07.982189+0000","last_became_peered":"2024-09-10T21:07:07.982189+0000","last_unstale":"2024-09-10T21:07:08.969223+0000","last_undegraded":"2024-09-10T21:07:08.969223+0000","last_fullsized":"2024-09-10T21:07:08.969223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:21.481889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983543+0000","last_change":"2024-09-10T21:07:09.003185+0000","last_active":"2024-09-10T21:07:09.983543+0000","last_peered":"2024-09-10T21:07:09.983543+0000","last_clean":"2024-09-10T21:07:09.983543+0000","last_became_active":"2024-09-10T21:07:09.002210+0000","last_became_peered":"2024-09-10T21:07:09.002210+0000","last_unstale":"2024-09-10T21:07:09.983543+0000","last_undegraded":"2024-09-10T21:07:09.983543+0000","last_fullsized":"2024-09-10T21:07:09.983543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.014308+0000","last_change":"2024-09-10T21:07:07.977268+0000","last_active":"2024-09-10T21:07:09.014308+0000","last_peered":"2024-09-10T21:07:09.014308+0000","last_clean":"2024-09-10T21:07:09.014308+0000","last_became_active":"2024-09-10T21:07:07.977016+0000","last_became_peered":"2024-09-10T21:07:07.977016+0000","last_unstale":"2024-09-10T21:07:09.014308+0000","last_undegraded":"2024-09-10T21:07:09.014308+0000","last_fullsized":"2024-09-10T21:07:09.014308+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982259+0000","last_change":"2024-09-10T21:07:08.996569+0000","last_active":"2024-09-10T21:07:09.982259+0000","last_peered":"2024-09-10T21:07:09.982259+0000","last_clean":"2024-09-10T21:07:09.982259+0000","last_became_active":"2024-09-10T21:07:08.996285+0000","last_became_peered":"2024-09-10T21:07:08.996285+0000","last_unstale":"2024-09-10T21:07:09.982259+0000","last_undegraded":"2024-09-10T21:07:09.982259+0000","last_fullsized":"2024-09-10T21:07:09.982259+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:35.706362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982755+0000","last_change":"2024-09-10T21:07:07.975307+0000","last_active":"2024-09-10T21:07:09.982755+0000","last_peered":"2024-09-10T21:07:09.982755+0000","last_clean":"2024-09-10T21:07:09.982755+0000","last_became_active":"2024-09-10T21:07:07.975034+0000","last_became_peered":"2024-09-10T21:07:07.975034+0000","last_unstale":"2024-09-10T21:07:09.982755+0000","last_undegraded":"2024-09-10T21:07:09.982755+0000","last_fullsized":"2024-09-10T21:07:09.982755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:59.494549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982671+0000","last_change":"2024-09-10T21:07:08.987536+0000","last_active":"2024-09-10T21:07:09.982671+0000","last_peered":"2024-09-10T21:07:09.982671+0000","last_clean":"2024-09-10T21:07:09.982671+0000","last_became_active":"2024-09-10T21:07:08.987218+0000","last_became_peered":"2024-09-10T21:07:08.987218+0000","last_unstale":"2024-09-10T21:07:09.982671+0000","last_undegraded":"2024-09-10T21:07:09.982671+0000","last_fullsized":"2024-09-10T21:07:09.982671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009907+0000","last_change":"2024-09-10T21:07:07.975529+0000","last_active":"2024-09-10T21:07:09.009907+0000","last_peered":"2024-09-10T21:07:09.009907+0000","last_clean":"2024-09-10T21:07:09.009907+0000","last_became_active":"2024-09-10T21:07:07.974601+0000","last_became_peered":"2024-09-10T21:07:07.974601+0000","last_unstale":"2024-09-10T21:07:09.009907+0000","last_undegraded":"2024-09-10T21:07:09.009907+0000","last_fullsized":"2024-09-10T21:07:09.009907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:15.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982837+0000","last_change":"2024-09-10T21:07:08.994668+0000","last_active":"2024-09-10T21:07:09.982837+0000","last_peered":"2024-09-10T21:07:09.982837+0000","last_clean":"2024-09-10T21:07:09.982837+0000","last_became_active":"2024-09-10T21:07:08.994384+0000","last_became_peered":"2024-09-10T21:07:08.994384+0000","last_unstale":"2024-09-10T21:07:09.982837+0000","last_undegraded":"2024-09-10T21:07:09.982837+0000","last_fullsized":"2024-09-10T21:07:09.982837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:14.061765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983445+0000","last_change":"2024-09-10T21:07:07.984389+0000","last_active":"2024-09-10T21:07:09.983445+0000","last_peered":"2024-09-10T21:07:09.983445+0000","last_clean":"2024-09-10T21:07:09.983445+0000","last_became_active":"2024-09-10T21:07:07.983958+0000","last_became_peered":"2024-09-10T21:07:07.983958+0000","last_unstale":"2024-09-10T21:07:09.983445+0000","last_undegraded":"2024-09-10T21:07:09.983445+0000","last_fullsized":"2024-09-10T21:07:09.983445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:38.916517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.230218+0000","last_change":"2024-09-10T21:07:08.989112+0000","last_active":"2024-09-10T21:07:11.230218+0000","last_peered":"2024-09-10T21:07:11.230218+0000","last_clean":"2024-09-10T21:07:11.230218+0000","last_became_active":"2024-09-10T21:07:08.988761+0000","last_became_peered":"2024-09-10T21:07:08.988761+0000","last_unstale":"2024-09-10T21:07:11.230218+0000","last_undegraded":"2024-09-10T21:07:11.230218+0000","last_fullsized":"2024-09-10T21:07:11.230218+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:11.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.229939+0000","last_change":"2024-09-10T21:07:07.980137+0000","last_active":"2024-09-10T21:07:11.229939+0000","last_peered":"2024-09-10T21:07:11.229939+0000","last_clean":"2024-09-10T21:07:11.229939+0000","last_became_active":"2024-09-10T21:07:07.979323+0000","last_became_peered":"2024-09-10T21:07:07.979323+0000","last_unstale":"2024-09-10T21:07:11.229939+0000","last_undegraded":"2024-09-10T21:07:11.229939+0000","last_fullsized":"2024-09-10T21:07:11.229939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:29.008858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.991928+0000","last_change":"2024-09-10T21:07:08.985488+0000","last_active":"2024-09-10T21:07:08.991928+0000","last_peered":"2024-09-10T21:07:08.991928+0000","last_clean":"2024-09-10T21:07:08.991928+0000","last_became_active":"2024-09-10T21:07:08.985240+0000","last_became_peered":"2024-09-10T21:07:08.985240+0000","last_unstale":"2024-09-10T21:07:08.991928+0000","last_undegraded":"2024-09-10T21:07:08.991928+0000","last_fullsized":"2024-09-10T21:07:08.991928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:21.219197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.230050+0000","last_change":"2024-09-10T21:07:07.981367+0000","last_active":"2024-09-10T21:07:11.230050+0000","last_peered":"2024-09-10T21:07:11.230050+0000","last_clean":"2024-09-10T21:07:11.230050+0000","last_became_active":"2024-09-10T21:07:07.981095+0000","last_became_peered":"2024-09-10T21:07:07.981095+0000","last_unstale":"2024-09-10T21:07:11.230050+0000","last_undegraded":"2024-09-10T21:07:11.230050+0000","last_fullsized":"2024-09-10T21:07:11.230050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:14.629281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.006712+0000","last_change":"2024-09-10T21:07:08.994822+0000","last_active":"2024-09-10T21:07:09.006712+0000","last_peered":"2024-09-10T21:07:09.006712+0000","last_clean":"2024-09-10T21:07:09.006712+0000","last_became_active":"2024-09-10T21:07:08.994580+0000","last_became_peered":"2024-09-10T21:07:08.994580+0000","last_unstale":"2024-09-10T21:07:09.006712+0000","last_undegraded":"2024-09-10T21:07:09.006712+0000","last_fullsized":"2024-09-10T21:07:09.006712+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981844+0000","last_change":"2024-09-10T21:07:07.970920+0000","last_active":"2024-09-10T21:07:09.981844+0000","last_peered":"2024-09-10T21:07:09.981844+0000","last_clean":"2024-09-10T21:07:09.981844+0000","last_became_active":"2024-09-10T21:07:07.970301+0000","last_became_peered":"2024-09-10T21:07:07.970301+0000","last_unstale":"2024-09-10T21:07:09.981844+0000","last_undegraded":"2024-09-10T21:07:09.981844+0000","last_fullsized":"2024-09-10T21:07:09.981844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988171+0000","last_change":"2024-09-10T21:07:08.990744+0000","last_active":"2024-09-10T21:07:09.988171+0000","last_peered":"2024-09-10T21:07:09.988171+0000","last_clean":"2024-09-10T21:07:09.988171+0000","last_became_active":"2024-09-10T21:07:08.989163+0000","last_became_peered":"2024-09-10T21:07:08.989163+0000","last_unstale":"2024-09-10T21:07:09.988171+0000","last_undegraded":"2024-09-10T21:07:09.988171+0000","last_fullsized":"2024-09-10T21:07:09.988171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982544+0000","last_change":"2024-09-10T21:07:07.974215+0000","last_active":"2024-09-10T21:07:09.982544+0000","last_peered":"2024-09-10T21:07:09.982544+0000","last_clean":"2024-09-10T21:07:09.982544+0000","last_became_active":"2024-09-10T21:07:07.973960+0000","last_became_peered":"2024-09-10T21:07:07.973960+0000","last_unstale":"2024-09-10T21:07:09.982544+0000","last_undegraded":"2024-09-10T21:07:09.982544+0000","last_fullsized":"2024-09-10T21:07:09.982544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.040936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.009159+0000","last_change":"2024-09-10T21:07:09.004117+0000","last_active":"2024-09-10T21:07:09.009159+0000","last_peered":"2024-09-10T21:07:09.009159+0000","last_clean":"2024-09-10T21:07:09.009159+0000","last_became_active":"2024-09-10T21:07:09.003435+0000","last_became_peered":"2024-09-10T21:07:09.003435+0000","last_unstale":"2024-09-10T21:07:09.009159+0000","last_undegraded":"2024-09-10T21:07:09.009159+0000","last_fullsized":"2024-09-10T21:07:09.009159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981579+0000","last_change":"2024-09-10T21:07:07.975653+0000","last_active":"2024-09-10T21:07:09.981579+0000","last_peered":"2024-09-10T21:07:09.981579+0000","last_clean":"2024-09-10T21:07:09.981579+0000","last_became_active":"2024-09-10T21:07:07.975383+0000","last_became_peered":"2024-09-10T21:07:07.975383+0000","last_unstale":"2024-09-10T21:07:09.981579+0000","last_undegraded":"2024-09-10T21:07:09.981579+0000","last_fullsized":"2024-09-10T21:07:09.981579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:24.484277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983577+0000","last_change":"2024-09-10T21:07:09.003571+0000","last_active":"2024-09-10T21:07:09.983577+0000","last_peered":"2024-09-10T21:07:09.983577+0000","last_clean":"2024-09-10T21:07:09.983577+0000","last_became_active":"2024-09-10T21:07:09.003282+0000","last_became_peered":"2024-09-10T21:07:09.003282+0000","last_unstale":"2024-09-10T21:07:09.983577+0000","last_undegraded":"2024-09-10T21:07:09.983577+0000","last_fullsized":"2024-09-10T21:07:09.983577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.004958+0000","last_change":"2024-09-10T21:07:07.982369+0000","last_active":"2024-09-10T21:07:09.004958+0000","last_peered":"2024-09-10T21:07:09.004958+0000","last_clean":"2024-09-10T21:07:09.004958+0000","last_became_active":"2024-09-10T21:07:07.982077+0000","last_became_peered":"2024-09-10T21:07:07.982077+0000","last_unstale":"2024-09-10T21:07:09.004958+0000","last_undegraded":"2024-09-10T21:07:09.004958+0000","last_fullsized":"2024-09-10T21:07:09.004958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:40.539770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988694+0000","last_change":"2024-09-10T21:07:08.989455+0000","last_active":"2024-09-10T21:07:09.988694+0000","last_peered":"2024-09-10T21:07:09.988694+0000","last_clean":"2024-09-10T21:07:09.988694+0000","last_became_active":"2024-09-10T21:07:08.989206+0000","last_became_peered":"2024-09-10T21:07:08.989206+0000","last_unstale":"2024-09-10T21:07:09.988694+0000","last_undegraded":"2024-09-10T21:07:09.988694+0000","last_fullsized":"2024-09-10T21:07:09.988694+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.987453+0000","last_change":"2024-09-10T21:07:07.984174+0000","last_active":"2024-09-10T21:07:09.987453+0000","last_peered":"2024-09-10T21:07:09.987453+0000","last_clean":"2024-09-10T21:07:09.987453+0000","last_became_active":"2024-09-10T21:07:07.983898+0000","last_became_peered":"2024-09-10T21:07:07.983898+0000","last_unstale":"2024-09-10T21:07:09.987453+0000","last_undegraded":"2024-09-10T21:07:09.987453+0000","last_fullsized":"2024-09-10T21:07:09.987453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.230105+0000","last_change":"2024-09-10T21:07:08.991284+0000","last_active":"2024-09-10T21:07:11.230105+0000","last_peered":"2024-09-10T21:07:11.230105+0000","last_clean":"2024-09-10T21:07:11.230105+0000","last_became_active":"2024-09-10T21:07:08.991010+0000","last_became_peered":"2024-09-10T21:07:08.991010+0000","last_unstale":"2024-09-10T21:07:11.230105+0000","last_undegraded":"2024-09-10T21:07:11.230105+0000","last_fullsized":"2024-09-10T21:07:11.230105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:35.802436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983503+0000","last_change":"2024-09-10T21:07:07.982520+0000","last_active":"2024-09-10T21:07:09.983503+0000","last_peered":"2024-09-10T21:07:09.983503+0000","last_clean":"2024-09-10T21:07:09.983503+0000","last_became_active":"2024-09-10T21:07:07.982215+0000","last_became_peered":"2024-09-10T21:07:07.982215+0000","last_unstale":"2024-09-10T21:07:09.983503+0000","last_undegraded":"2024-09-10T21:07:09.983503+0000","last_fullsized":"2024-09-10T21:07:09.983503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:38.024808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982590+0000","last_change":"2024-09-10T21:07:09.000771+0000","last_active":"2024-09-10T21:07:09.982590+0000","last_peered":"2024-09-10T21:07:09.982590+0000","last_clean":"2024-09-10T21:07:09.982590+0000","last_became_active":"2024-09-10T21:07:09.000225+0000","last_became_peered":"2024-09-10T21:07:09.000225+0000","last_unstale":"2024-09-10T21:07:09.982590+0000","last_undegraded":"2024-09-10T21:07:09.982590+0000","last_fullsized":"2024-09-10T21:07:09.982590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.975892+0000","last_change":"2024-09-10T21:07:07.972550+0000","last_active":"2024-09-10T21:07:08.975892+0000","last_peered":"2024-09-10T21:07:08.975892+0000","last_clean":"2024-09-10T21:07:08.975892+0000","last_became_active":"2024-09-10T21:07:07.972258+0000","last_became_peered":"2024-09-10T21:07:07.972258+0000","last_unstale":"2024-09-10T21:07:08.975892+0000","last_undegraded":"2024-09-10T21:07:08.975892+0000","last_fullsized":"2024-09-10T21:07:08.975892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:54.175968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981812+0000","last_change":"2024-09-10T21:07:08.993085+0000","last_active":"2024-09-10T21:07:09.981812+0000","last_peered":"2024-09-10T21:07:09.981812+0000","last_clean":"2024-09-10T21:07:09.981812+0000","last_became_active":"2024-09-10T21:07:08.992693+0000","last_became_peered":"2024-09-10T21:07:08.992693+0000","last_unstale":"2024-09-10T21:07:09.981812+0000","last_undegraded":"2024-09-10T21:07:09.981812+0000","last_fullsized":"2024-09-10T21:07:09.981812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:29.416774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988406+0000","last_change":"2024-09-10T21:07:07.984281+0000","last_active":"2024-09-10T21:07:09.988406+0000","last_peered":"2024-09-10T21:07:09.988406+0000","last_clean":"2024-09-10T21:07:09.988406+0000","last_became_active":"2024-09-10T21:07:07.983954+0000","last_became_peered":"2024-09-10T21:07:07.983954+0000","last_unstale":"2024-09-10T21:07:09.988406+0000","last_undegraded":"2024-09-10T21:07:09.988406+0000","last_fullsized":"2024-09-10T21:07:09.988406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:15.341376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.989535+0000","last_change":"2024-09-10T21:07:08.982222+0000","last_active":"2024-09-10T21:07:08.989535+0000","last_peered":"2024-09-10T21:07:08.989535+0000","last_clean":"2024-09-10T21:07:08.989535+0000","last_became_active":"2024-09-10T21:07:08.981942+0000","last_became_peered":"2024-09-10T21:07:08.981942+0000","last_unstale":"2024-09-10T21:07:08.989535+0000","last_undegraded":"2024-09-10T21:07:08.989535+0000","last_fullsized":"2024-09-10T21:07:08.989535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:18.777246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.969247+0000","last_change":"2024-09-10T21:07:07.982359+0000","last_active":"2024-09-10T21:07:08.969247+0000","last_peered":"2024-09-10T21:07:08.969247+0000","last_clean":"2024-09-10T21:07:08.969247+0000","last_became_active":"2024-09-10T21:07:07.982087+0000","last_became_peered":"2024-09-10T21:07:07.982087+0000","last_unstale":"2024-09-10T21:07:08.969247+0000","last_undegraded":"2024-09-10T21:07:08.969247+0000","last_fullsized":"2024-09-10T21:07:08.969247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:44.164885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988331+0000","last_change":"2024-09-10T21:07:08.994477+0000","last_active":"2024-09-10T21:07:09.988331+0000","last_peered":"2024-09-10T21:07:09.988331+0000","last_clean":"2024-09-10T21:07:09.988331+0000","last_became_active":"2024-09-10T21:07:08.994228+0000","last_became_peered":"2024-09-10T21:07:08.994228+0000","last_unstale":"2024-09-10T21:07:09.988331+0000","last_undegraded":"2024-09-10T21:07:09.988331+0000","last_fullsized":"2024-09-10T21:07:09.988331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:08.972673+0000","last_change":"2024-09-10T21:07:07.977266+0000","last_active":"2024-09-10T21:07:08.972673+0000","last_peered":"2024-09-10T21:07:08.972673+0000","last_clean":"2024-09-10T21:07:08.972673+0000","last_became_active":"2024-09-10T21:07:07.976927+0000","last_became_peered":"2024-09-10T21:07:07.976927+0000","last_unstale":"2024-09-10T21:07:08.972673+0000","last_undegraded":"2024-09-10T21:07:08.972673+0000","last_fullsized":"2024-09-10T21:07:08.972673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:04.086693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.001054+0000","last_change":"2024-09-10T21:07:08.996299+0000","last_active":"2024-09-10T21:07:09.001054+0000","last_peered":"2024-09-10T21:07:09.001054+0000","last_clean":"2024-09-10T21:07:09.001054+0000","last_became_active":"2024-09-10T21:07:08.995907+0000","last_became_peered":"2024-09-10T21:07:08.995907+0000","last_unstale":"2024-09-10T21:07:09.001054+0000","last_undegraded":"2024-09-10T21:07:09.001054+0000","last_fullsized":"2024-09-10T21:07:09.001054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:37.059713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988421+0000","last_change":"2024-09-10T21:07:07.979476+0000","last_active":"2024-09-10T21:07:09.988421+0000","last_peered":"2024-09-10T21:07:09.988421+0000","last_clean":"2024-09-10T21:07:09.988421+0000","last_became_active":"2024-09-10T21:07:07.979192+0000","last_became_peered":"2024-09-10T21:07:07.979192+0000","last_unstale":"2024-09-10T21:07:09.988421+0000","last_undegraded":"2024-09-10T21:07:09.988421+0000","last_fullsized":"2024-09-10T21:07:09.988421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:25.005206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982211+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:09.982211+0000","last_peered":"2024-09-10T21:07:09.982211+0000","last_clean":"2024-09-10T21:07:09.982211+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:09.982211+0000","last_undegraded":"2024-09-10T21:07:09.982211+0000","last_fullsized":"2024-09-10T21:07:09.982211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":195285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":193639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":195743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1064960,"data_stored":790631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":791191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:17.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.042+0000 7f8ce4200640 1 -- 172.21.15.100:0/1770879372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc15c010 msgr2=0x7f8cdc0cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.042+0000 7f8ce4200640 1 --2- 172.21.15.100:0/1770879372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc15c010 0x7f8cdc0cebe0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc072210 tx=0x7f8cc802a5f0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.042+0000 7f8ce4200640 1 -- 172.21.15.100:0/1770879372 shutdown_connections 2024-09-10T21:07:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.042+0000 7f8ce4200640 1 --2- 172.21.15.100:0/1770879372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc15c010 0x7f8cdc0cebe0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.042+0000 7f8ce4200640 1 --2- 172.21.15.100:0/1770879372 >> v2:172.21.15.130:3300/0 conn(0x7f8cdc0b3dc0 0x7f8cdc0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.042+0000 7f8ce4200640 1 -- 172.21.15.100:0/1770879372 >> 172.21.15.100:0/1770879372 conn(0x7f8cdc0cc7d0 msgr2=0x7f8cdc0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.042+0000 7f8ce4200640 1 -- 172.21.15.100:0/1770879372 shutdown_connections 2024-09-10T21:07:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.042+0000 7f8ce4200640 1 -- 172.21.15.100:0/1770879372 wait complete. 2024-09-10T21:07:18.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.043+0000 7f8ce4200640 1 Processor -- start 2024-09-10T21:07:18.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.044+0000 7f8ce4200640 1 -- start start 2024-09-10T21:07:18.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.044+0000 7f8ce4200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cdc0b3dc0 0x7f8cdc1f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:18.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce4200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc0cf120 0x7f8cdc142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce4200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cdc15c010 0x7f8cdc14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce4200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc15e7f0 con 0x7f8cdc0cf120 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce4200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc15e670 con 0x7f8cdc0b3dc0 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce4200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8cdc15e970 con 0x7f8cdc15c010 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc0cf120 0x7f8cdc142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc0cf120 0x7f8cdc142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32962/0 (socket says 172.21.15.100:32962) 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce0e00640 1 -- 172.21.15.100:0/4064209194 learned_addr learned my addr 172.21.15.100:0/4064209194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce1800640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cdc0b3dc0 0x7f8cdc1f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce2200640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cdc15c010 0x7f8cdc14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce0e00640 1 -- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cdc15c010 msgr2=0x7f8cdc14d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce0e00640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cdc15c010 0x7f8cdc14d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce0e00640 1 -- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cdc0b3dc0 msgr2=0x7f8cdc1f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce0e00640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cdc0b3dc0 0x7f8cdc1f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.045+0000 7f8ce0e00640 1 -- 172.21.15.100:0/4064209194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cdc155220 con 0x7f8cdc0cf120 2024-09-10T21:07:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.046+0000 7f8ce0e00640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc0cf120 0x7f8cdc142490 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8034040 tx=0x7f8cc8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.046+0000 7f8cd9600640 1 -- 172.21.15.100:0/4064209194 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc803e030 con 0x7f8cdc0cf120 2024-09-10T21:07:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.046+0000 7f8cd9600640 1 -- 172.21.15.100:0/4064209194 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cc8003e00 con 0x7f8cdc0cf120 2024-09-10T21:07:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.046+0000 7f8cd9600640 1 -- 172.21.15.100:0/4064209194 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8035040 con 0x7f8cdc0cf120 2024-09-10T21:07:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.046+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cdc142be0 con 0x7f8cdc0cf120 2024-09-10T21:07:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.046+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cdc1431a0 con 0x7f8cdc0cf120 2024-09-10T21:07:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.047+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cdc160120 con 0x7f8cdc0cf120 2024-09-10T21:07:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.048+0000 7f8cd9600640 1 -- 172.21.15.100:0/4064209194 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8cc80049c0 con 0x7f8cdc0cf120 2024-09-10T21:07:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.049+0000 7f8cd9600640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8cbc077fa0 0x7f8cbc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.049+0000 7f8cd9600640 1 -- 172.21.15.100:0/4064209194 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f8cc80ba930 con 0x7f8cdc0cf120 2024-09-10T21:07:18.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.050+0000 7f8ce1800640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8cbc077fa0 0x7f8cbc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:18.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.050+0000 7f8ce1800640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8cbc077fa0 0x7f8cbc07a460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000bbe0 tx=0x7f8cd000b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:18.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.053+0000 7f8cd9600640 1 -- 172.21.15.100:0/4064209194 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8cdc155220 con 0x7f8cdc0cf120 2024-09-10T21:07:18.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.240+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cdc068d40 con 0x7f8cbc077fa0 2024-09-10T21:07:18.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.245+0000 7f8cd9600640 1 -- 172.21.15.100:0/4064209194 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251881 (secure 0 0 0) 0x7f8cdc068d40 con 0x7f8cbc077fa0 2024-09-10T21:07:18.253 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:18.254 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:18.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.248+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8cbc077fa0 msgr2=0x7f8cbc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8cbc077fa0 0x7f8cbc07a460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000bbe0 tx=0x7f8cd000b390 comp rx=0 tx=0).stop 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc0cf120 msgr2=0x7f8cdc142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc0cf120 0x7f8cdc142490 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8034040 tx=0x7f8cc8003910 comp rx=0 tx=0).stop 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 shutdown_connections 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cdc15c010 0x7f8cdc14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cdc0cf120 0x7f8cdc142490 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f8cbc077fa0 0x7f8cbc07a460 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 --2- 172.21.15.100:0/4064209194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cdc0b3dc0 0x7f8cdc1f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 >> 172.21.15.100:0/4064209194 conn(0x7f8cdc0cc7d0 msgr2=0x7f8cdc159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 shutdown_connections 2024-09-10T21:07:18.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.249+0000 7f8ce4200640 1 -- 172.21.15.100:0/4064209194 wait complete. 2024-09-10T21:07:18.269 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-09-10T21:07:16.705119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221104,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":4988928,"data_stored":2787484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002035"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979752+0000","last_change":"2024-09-10T21:07:08.993655+0000","last_active":"2024-09-10T21:07:11.979752+0000","last_peered":"2024-09-10T21:07:11.979752+0000","last_clean":"2024-09-10T21:07:11.979752+0000","last_became_active":"2024-09-10T21:07:08.991972+0000","last_became_peered":"2024-09-10T21:07:08.991972+0000","last_unstale":"2024-09-10T21:07:11.979752+0000","last_undegraded":"2024-09-10T21:07:11.979752+0000","last_fullsized":"2024-09-10T21:07:11.979752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:29.164663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983097+0000","last_change":"2024-09-10T21:07:08.993612+0000","last_active":"2024-09-10T21:07:09.983097+0000","last_peered":"2024-09-10T21:07:09.983097+0000","last_clean":"2024-09-10T21:07:09.983097+0000","last_became_active":"2024-09-10T21:07:08.993291+0000","last_became_peered":"2024-09-10T21:07:08.993291+0000","last_unstale":"2024-09-10T21:07:09.983097+0000","last_undegraded":"2024-09-10T21:07:09.983097+0000","last_fullsized":"2024-09-10T21:07:09.983097+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.980099+0000","last_change":"2024-09-10T21:07:08.986654+0000","last_active":"2024-09-10T21:07:11.980099+0000","last_peered":"2024-09-10T21:07:11.980099+0000","last_clean":"2024-09-10T21:07:11.980099+0000","last_became_active":"2024-09-10T21:07:08.986313+0000","last_became_peered":"2024-09-10T21:07:08.986313+0000","last_unstale":"2024-09-10T21:07:11.980099+0000","last_undegraded":"2024-09-10T21:07:11.980099+0000","last_fullsized":"2024-09-10T21:07:11.980099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:25.656206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979825+0000","last_change":"2024-09-10T21:07:08.992089+0000","last_active":"2024-09-10T21:07:11.979825+0000","last_peered":"2024-09-10T21:07:11.979825+0000","last_clean":"2024-09-10T21:07:11.979825+0000","last_became_active":"2024-09-10T21:07:08.991795+0000","last_became_peered":"2024-09-10T21:07:08.991795+0000","last_unstale":"2024-09-10T21:07:11.979825+0000","last_undegraded":"2024-09-10T21:07:11.979825+0000","last_fullsized":"2024-09-10T21:07:11.979825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:30.820993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983410+0000","last_change":"2024-09-10T21:07:09.006257+0000","last_active":"2024-09-10T21:07:09.983410+0000","last_peered":"2024-09-10T21:07:09.983410+0000","last_clean":"2024-09-10T21:07:09.983410+0000","last_became_active":"2024-09-10T21:07:09.005851+0000","last_became_peered":"2024-09-10T21:07:09.005851+0000","last_unstale":"2024-09-10T21:07:09.983410+0000","last_undegraded":"2024-09-10T21:07:09.983410+0000","last_fullsized":"2024-09-10T21:07:09.983410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981787+0000","last_change":"2024-09-10T21:07:08.985543+0000","last_active":"2024-09-10T21:07:09.981787+0000","last_peered":"2024-09-10T21:07:09.981787+0000","last_clean":"2024-09-10T21:07:09.981787+0000","last_became_active":"2024-09-10T21:07:08.981933+0000","last_became_peered":"2024-09-10T21:07:08.981933+0000","last_unstale":"2024-09-10T21:07:09.981787+0000","last_undegraded":"2024-09-10T21:07:09.981787+0000","last_fullsized":"2024-09-10T21:07:09.981787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:55.184003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982434+0000","last_change":"2024-09-10T21:07:08.991775+0000","last_active":"2024-09-10T21:07:09.982434+0000","last_peered":"2024-09-10T21:07:09.982434+0000","last_clean":"2024-09-10T21:07:09.982434+0000","last_became_active":"2024-09-10T21:07:08.991499+0000","last_became_peered":"2024-09-10T21:07:08.991499+0000","last_unstale":"2024-09-10T21:07:09.982434+0000","last_undegraded":"2024-09-10T21:07:09.982434+0000","last_fullsized":"2024-09-10T21:07:09.982434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979317+0000","last_change":"2024-09-10T21:07:09.003113+0000","last_active":"2024-09-10T21:07:11.979317+0000","last_peered":"2024-09-10T21:07:11.979317+0000","last_clean":"2024-09-10T21:07:11.979317+0000","last_became_active":"2024-09-10T21:07:09.002875+0000","last_became_peered":"2024-09-10T21:07:09.002875+0000","last_unstale":"2024-09-10T21:07:11.979317+0000","last_undegraded":"2024-09-10T21:07:11.979317+0000","last_fullsized":"2024-09-10T21:07:11.979317+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:53.458288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983824+0000","last_change":"2024-09-10T21:07:08.995695+0000","last_active":"2024-09-10T21:07:09.983824+0000","last_peered":"2024-09-10T21:07:09.983824+0000","last_clean":"2024-09-10T21:07:09.983824+0000","last_became_active":"2024-09-10T21:07:08.995450+0000","last_became_peered":"2024-09-10T21:07:08.995450+0000","last_unstale":"2024-09-10T21:07:09.983824+0000","last_undegraded":"2024-09-10T21:07:09.983824+0000","last_fullsized":"2024-09-10T21:07:09.983824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982683+0000","last_change":"2024-09-10T21:07:08.987778+0000","last_active":"2024-09-10T21:07:09.982683+0000","last_peered":"2024-09-10T21:07:09.982683+0000","last_clean":"2024-09-10T21:07:09.982683+0000","last_became_active":"2024-09-10T21:07:08.987558+0000","last_became_peered":"2024-09-10T21:07:08.987558+0000","last_unstale":"2024-09-10T21:07:09.982683+0000","last_undegraded":"2024-09-10T21:07:09.982683+0000","last_fullsized":"2024-09-10T21:07:09.982683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:26.013241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988586+0000","last_change":"2024-09-10T21:07:09.004347+0000","last_active":"2024-09-10T21:07:09.988586+0000","last_peered":"2024-09-10T21:07:09.988586+0000","last_clean":"2024-09-10T21:07:09.988586+0000","last_became_active":"2024-09-10T21:07:09.004076+0000","last_became_peered":"2024-09-10T21:07:09.004076+0000","last_unstale":"2024-09-10T21:07:09.988586+0000","last_undegraded":"2024-09-10T21:07:09.988586+0000","last_fullsized":"2024-09-10T21:07:09.988586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.933825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983673+0000","last_change":"2024-09-10T21:07:09.001468+0000","last_active":"2024-09-10T21:07:09.983673+0000","last_peered":"2024-09-10T21:07:09.983673+0000","last_clean":"2024-09-10T21:07:09.983673+0000","last_became_active":"2024-09-10T21:07:09.001207+0000","last_became_peered":"2024-09-10T21:07:09.001207+0000","last_unstale":"2024-09-10T21:07:09.983673+0000","last_undegraded":"2024-09-10T21:07:09.983673+0000","last_fullsized":"2024-09-10T21:07:09.983673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982349+0000","last_change":"2024-09-10T21:07:08.995284+0000","last_active":"2024-09-10T21:07:09.982349+0000","last_peered":"2024-09-10T21:07:09.982349+0000","last_clean":"2024-09-10T21:07:09.982349+0000","last_became_active":"2024-09-10T21:07:08.994529+0000","last_became_peered":"2024-09-10T21:07:08.994529+0000","last_unstale":"2024-09-10T21:07:09.982349+0000","last_undegraded":"2024-09-10T21:07:09.982349+0000","last_fullsized":"2024-09-10T21:07:09.982349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:17.449916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.487100+0000","last_change":"2024-09-10T21:07:08.988477+0000","last_active":"2024-09-10T21:07:11.487100+0000","last_peered":"2024-09-10T21:07:11.487100+0000","last_clean":"2024-09-10T21:07:11.487100+0000","last_became_active":"2024-09-10T21:07:08.988146+0000","last_became_peered":"2024-09-10T21:07:08.988146+0000","last_unstale":"2024-09-10T21:07:11.487100+0000","last_undegraded":"2024-09-10T21:07:11.487100+0000","last_fullsized":"2024-09-10T21:07:11.487100+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:11.433307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.978818+0000","last_change":"2024-09-10T21:07:08.992983+0000","last_active":"2024-09-10T21:07:11.978818+0000","last_peered":"2024-09-10T21:07:11.978818+0000","last_clean":"2024-09-10T21:07:11.978818+0000","last_became_active":"2024-09-10T21:07:08.992683+0000","last_became_peered":"2024-09-10T21:07:08.992683+0000","last_unstale":"2024-09-10T21:07:11.978818+0000","last_undegraded":"2024-09-10T21:07:11.978818+0000","last_fullsized":"2024-09-10T21:07:11.978818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:43.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982205+0000","last_change":"2024-09-10T21:07:08.982108+0000","last_active":"2024-09-10T21:07:09.982205+0000","last_peered":"2024-09-10T21:07:09.982205+0000","last_clean":"2024-09-10T21:07:09.982205+0000","last_became_active":"2024-09-10T21:07:08.981887+0000","last_became_peered":"2024-09-10T21:07:08.981887+0000","last_unstale":"2024-09-10T21:07:09.982205+0000","last_undegraded":"2024-09-10T21:07:09.982205+0000","last_fullsized":"2024-09-10T21:07:09.982205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979552+0000","last_change":"2024-09-10T21:07:08.986295+0000","last_active":"2024-09-10T21:07:11.979552+0000","last_peered":"2024-09-10T21:07:11.979552+0000","last_clean":"2024-09-10T21:07:11.979552+0000","last_became_active":"2024-09-10T21:07:08.983589+0000","last_became_peered":"2024-09-10T21:07:08.983589+0000","last_unstale":"2024-09-10T21:07:11.979552+0000","last_undegraded":"2024-09-10T21:07:11.979552+0000","last_fullsized":"2024-09-10T21:07:11.979552+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:41.096706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979368+0000","last_change":"2024-09-10T21:07:08.987716+0000","last_active":"2024-09-10T21:07:11.979368+0000","last_peered":"2024-09-10T21:07:11.979368+0000","last_clean":"2024-09-10T21:07:11.979368+0000","last_became_active":"2024-09-10T21:07:08.986131+0000","last_became_peered":"2024-09-10T21:07:08.986131+0000","last_unstale":"2024-09-10T21:07:11.979368+0000","last_undegraded":"2024-09-10T21:07:11.979368+0000","last_fullsized":"2024-09-10T21:07:11.979368+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:28.683661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.230168+0000","last_change":"2024-09-10T21:07:08.994052+0000","last_active":"2024-09-10T21:07:11.230168+0000","last_peered":"2024-09-10T21:07:11.230168+0000","last_clean":"2024-09-10T21:07:11.230168+0000","last_became_active":"2024-09-10T21:07:08.993765+0000","last_became_peered":"2024-09-10T21:07:08.993765+0000","last_unstale":"2024-09-10T21:07:11.230168+0000","last_undegraded":"2024-09-10T21:07:11.230168+0000","last_fullsized":"2024-09-10T21:07:11.230168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:48.077211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988341+0000","last_change":"2024-09-10T21:07:08.989449+0000","last_active":"2024-09-10T21:07:09.988341+0000","last_peered":"2024-09-10T21:07:09.988341+0000","last_clean":"2024-09-10T21:07:09.988341+0000","last_became_active":"2024-09-10T21:07:08.988365+0000","last_became_peered":"2024-09-10T21:07:08.988365+0000","last_unstale":"2024-09-10T21:07:09.988341+0000","last_undegraded":"2024-09-10T21:07:09.988341+0000","last_fullsized":"2024-09-10T21:07:09.988341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:15.897184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988657+0000","last_change":"2024-09-10T21:07:08.984966+0000","last_active":"2024-09-10T21:07:09.988657+0000","last_peered":"2024-09-10T21:07:09.988657+0000","last_clean":"2024-09-10T21:07:09.988657+0000","last_became_active":"2024-09-10T21:07:08.984696+0000","last_became_peered":"2024-09-10T21:07:08.984696+0000","last_unstale":"2024-09-10T21:07:09.988657+0000","last_undegraded":"2024-09-10T21:07:09.988657+0000","last_fullsized":"2024-09-10T21:07:09.988657+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:48.470274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988163+0000","last_change":"2024-09-10T21:07:08.992572+0000","last_active":"2024-09-10T21:07:09.988163+0000","last_peered":"2024-09-10T21:07:09.988163+0000","last_clean":"2024-09-10T21:07:09.988163+0000","last_became_active":"2024-09-10T21:07:08.992231+0000","last_became_peered":"2024-09-10T21:07:08.992231+0000","last_unstale":"2024-09-10T21:07:09.988163+0000","last_undegraded":"2024-09-10T21:07:09.988163+0000","last_fullsized":"2024-09-10T21:07:09.988163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.978833+0000","last_change":"2024-09-10T21:07:08.990954+0000","last_active":"2024-09-10T21:07:11.978833+0000","last_peered":"2024-09-10T21:07:11.978833+0000","last_clean":"2024-09-10T21:07:11.978833+0000","last_became_active":"2024-09-10T21:07:08.989166+0000","last_became_peered":"2024-09-10T21:07:08.989166+0000","last_unstale":"2024-09-10T21:07:11.978833+0000","last_undegraded":"2024-09-10T21:07:11.978833+0000","last_fullsized":"2024-09-10T21:07:11.978833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:51.135500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979545+0000","last_change":"2024-09-10T21:07:08.998488+0000","last_active":"2024-09-10T21:07:11.979545+0000","last_peered":"2024-09-10T21:07:11.979545+0000","last_clean":"2024-09-10T21:07:11.979545+0000","last_became_active":"2024-09-10T21:07:08.997677+0000","last_became_peered":"2024-09-10T21:07:08.997677+0000","last_unstale":"2024-09-10T21:07:11.979545+0000","last_undegraded":"2024-09-10T21:07:11.979545+0000","last_fullsized":"2024-09-10T21:07:11.979545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:21.671425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.487181+0000","last_change":"2024-09-10T21:07:09.003139+0000","last_active":"2024-09-10T21:07:11.487181+0000","last_peered":"2024-09-10T21:07:11.487181+0000","last_clean":"2024-09-10T21:07:11.487181+0000","last_became_active":"2024-09-10T21:07:09.002972+0000","last_became_peered":"2024-09-10T21:07:09.002972+0000","last_unstale":"2024-09-10T21:07:11.487181+0000","last_undegraded":"2024-09-10T21:07:11.487181+0000","last_fullsized":"2024-09-10T21:07:11.487181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:35.828207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979653+0000","last_change":"2024-09-10T21:07:08.998658+0000","last_active":"2024-09-10T21:07:11.979653+0000","last_peered":"2024-09-10T21:07:11.979653+0000","last_clean":"2024-09-10T21:07:11.979653+0000","last_became_active":"2024-09-10T21:07:08.993838+0000","last_became_peered":"2024-09-10T21:07:08.993838+0000","last_unstale":"2024-09-10T21:07:11.979653+0000","last_undegraded":"2024-09-10T21:07:11.979653+0000","last_fullsized":"2024-09-10T21:07:11.979653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:56.987080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988654+0000","last_change":"2024-09-10T21:07:08.997383+0000","last_active":"2024-09-10T21:07:09.988654+0000","last_peered":"2024-09-10T21:07:09.988654+0000","last_clean":"2024-09-10T21:07:09.988654+0000","last_became_active":"2024-09-10T21:07:08.997089+0000","last_became_peered":"2024-09-10T21:07:08.997089+0000","last_unstale":"2024-09-10T21:07:09.988654+0000","last_undegraded":"2024-09-10T21:07:09.988654+0000","last_fullsized":"2024-09-10T21:07:09.988654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:25.346873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982632+0000","last_change":"2024-09-10T21:07:08.993822+0000","last_active":"2024-09-10T21:07:09.982632+0000","last_peered":"2024-09-10T21:07:09.982632+0000","last_clean":"2024-09-10T21:07:09.982632+0000","last_became_active":"2024-09-10T21:07:08.991716+0000","last_became_peered":"2024-09-10T21:07:08.991716+0000","last_unstale":"2024-09-10T21:07:09.982632+0000","last_undegraded":"2024-09-10T21:07:09.982632+0000","last_fullsized":"2024-09-10T21:07:09.982632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:18.937698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.978980+0000","last_change":"2024-09-10T21:07:08.988982+0000","last_active":"2024-09-10T21:07:11.978980+0000","last_peered":"2024-09-10T21:07:11.978980+0000","last_clean":"2024-09-10T21:07:11.978980+0000","last_became_active":"2024-09-10T21:07:08.988654+0000","last_became_peered":"2024-09-10T21:07:08.988654+0000","last_unstale":"2024-09-10T21:07:11.978980+0000","last_undegraded":"2024-09-10T21:07:11.978980+0000","last_fullsized":"2024-09-10T21:07:11.978980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:47.467599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.978941+0000","last_change":"2024-09-10T21:07:08.989788+0000","last_active":"2024-09-10T21:07:11.978941+0000","last_peered":"2024-09-10T21:07:11.978941+0000","last_clean":"2024-09-10T21:07:11.978941+0000","last_became_active":"2024-09-10T21:07:08.988825+0000","last_became_peered":"2024-09-10T21:07:08.988825+0000","last_unstale":"2024-09-10T21:07:11.978941+0000","last_undegraded":"2024-09-10T21:07:11.978941+0000","last_fullsized":"2024-09-10T21:07:11.978941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:00.315124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982533+0000","last_change":"2024-09-10T21:07:08.982659+0000","last_active":"2024-09-10T21:07:09.982533+0000","last_peered":"2024-09-10T21:07:09.982533+0000","last_clean":"2024-09-10T21:07:09.982533+0000","last_became_active":"2024-09-10T21:07:08.982365+0000","last_became_peered":"2024-09-10T21:07:08.982365+0000","last_unstale":"2024-09-10T21:07:09.982533+0000","last_undegraded":"2024-09-10T21:07:09.982533+0000","last_fullsized":"2024-09-10T21:07:09.982533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979724+0000","last_change":"2024-09-10T21:07:08.998256+0000","last_active":"2024-09-10T21:07:11.979724+0000","last_peered":"2024-09-10T21:07:11.979724+0000","last_clean":"2024-09-10T21:07:11.979724+0000","last_became_active":"2024-09-10T21:07:08.994815+0000","last_became_peered":"2024-09-10T21:07:08.994815+0000","last_unstale":"2024-09-10T21:07:11.979724+0000","last_undegraded":"2024-09-10T21:07:11.979724+0000","last_fullsized":"2024-09-10T21:07:11.979724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:21.162726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979241+0000","last_change":"2024-09-10T21:07:08.989239+0000","last_active":"2024-09-10T21:07:11.979241+0000","last_peered":"2024-09-10T21:07:11.979241+0000","last_clean":"2024-09-10T21:07:11.979241+0000","last_became_active":"2024-09-10T21:07:08.988990+0000","last_became_peered":"2024-09-10T21:07:08.988990+0000","last_unstale":"2024-09-10T21:07:11.979241+0000","last_undegraded":"2024-09-10T21:07:11.979241+0000","last_fullsized":"2024-09-10T21:07:11.979241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:33.424549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.487200+0000","last_change":"2024-09-10T21:07:07.982303+0000","last_active":"2024-09-10T21:07:11.487200+0000","last_peered":"2024-09-10T21:07:11.487200+0000","last_clean":"2024-09-10T21:07:11.487200+0000","last_became_active":"2024-09-10T21:07:07.982051+0000","last_became_peered":"2024-09-10T21:07:07.982051+0000","last_unstale":"2024-09-10T21:07:11.487200+0000","last_undegraded":"2024-09-10T21:07:11.487200+0000","last_fullsized":"2024-09-10T21:07:11.487200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:36.620013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982710+0000","last_change":"2024-09-10T21:07:08.989864+0000","last_active":"2024-09-10T21:07:09.982710+0000","last_peered":"2024-09-10T21:07:09.982710+0000","last_clean":"2024-09-10T21:07:09.982710+0000","last_became_active":"2024-09-10T21:07:08.989615+0000","last_became_peered":"2024-09-10T21:07:08.989615+0000","last_unstale":"2024-09-10T21:07:09.982710+0000","last_undegraded":"2024-09-10T21:07:09.982710+0000","last_fullsized":"2024-09-10T21:07:09.982710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982909+0000","last_change":"2024-09-10T21:07:07.975121+0000","last_active":"2024-09-10T21:07:09.982909+0000","last_peered":"2024-09-10T21:07:09.982909+0000","last_clean":"2024-09-10T21:07:09.982909+0000","last_became_active":"2024-09-10T21:07:07.974854+0000","last_became_peered":"2024-09-10T21:07:07.974854+0000","last_unstale":"2024-09-10T21:07:09.982909+0000","last_undegraded":"2024-09-10T21:07:09.982909+0000","last_fullsized":"2024-09-10T21:07:09.982909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979523+0000","last_change":"2024-09-10T21:07:08.984081+0000","last_active":"2024-09-10T21:07:11.979523+0000","last_peered":"2024-09-10T21:07:11.979523+0000","last_clean":"2024-09-10T21:07:11.979523+0000","last_became_active":"2024-09-10T21:07:08.983081+0000","last_became_peered":"2024-09-10T21:07:08.983081+0000","last_unstale":"2024-09-10T21:07:11.979523+0000","last_undegraded":"2024-09-10T21:07:11.979523+0000","last_fullsized":"2024-09-10T21:07:11.979523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:47.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.980138+0000","last_change":"2024-09-10T21:07:07.974937+0000","last_active":"2024-09-10T21:07:11.980138+0000","last_peered":"2024-09-10T21:07:11.980138+0000","last_clean":"2024-09-10T21:07:11.980138+0000","last_became_active":"2024-09-10T21:07:07.973491+0000","last_became_peered":"2024-09-10T21:07:07.973491+0000","last_unstale":"2024-09-10T21:07:11.980138+0000","last_undegraded":"2024-09-10T21:07:11.980138+0000","last_fullsized":"2024-09-10T21:07:11.980138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:28.408739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982984+0000","last_change":"2024-09-10T21:07:08.989505+0000","last_active":"2024-09-10T21:07:09.982984+0000","last_peered":"2024-09-10T21:07:09.982984+0000","last_clean":"2024-09-10T21:07:09.982984+0000","last_became_active":"2024-09-10T21:07:08.988284+0000","last_became_peered":"2024-09-10T21:07:08.988284+0000","last_unstale":"2024-09-10T21:07:09.982984+0000","last_undegraded":"2024-09-10T21:07:09.982984+0000","last_fullsized":"2024-09-10T21:07:09.982984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:03.639715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.487191+0000","last_change":"2024-09-10T21:07:07.983144+0000","last_active":"2024-09-10T21:07:11.487191+0000","last_peered":"2024-09-10T21:07:11.487191+0000","last_clean":"2024-09-10T21:07:11.487191+0000","last_became_active":"2024-09-10T21:07:07.982903+0000","last_became_peered":"2024-09-10T21:07:07.982903+0000","last_unstale":"2024-09-10T21:07:11.487191+0000","last_undegraded":"2024-09-10T21:07:11.487191+0000","last_fullsized":"2024-09-10T21:07:11.487191+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979969+0000","last_change":"2024-09-10T21:07:08.997979+0000","last_active":"2024-09-10T21:07:11.979969+0000","last_peered":"2024-09-10T21:07:11.979969+0000","last_clean":"2024-09-10T21:07:11.979969+0000","last_became_active":"2024-09-10T21:07:08.994323+0000","last_became_peered":"2024-09-10T21:07:08.994323+0000","last_unstale":"2024-09-10T21:07:11.979969+0000","last_undegraded":"2024-09-10T21:07:11.979969+0000","last_fullsized":"2024-09-10T21:07:11.979969+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:27.321678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.487036+0000","last_change":"2024-09-10T21:07:07.980708+0000","last_active":"2024-09-10T21:07:11.487036+0000","last_peered":"2024-09-10T21:07:11.487036+0000","last_clean":"2024-09-10T21:07:11.487036+0000","last_became_active":"2024-09-10T21:07:07.980440+0000","last_became_peered":"2024-09-10T21:07:07.980440+0000","last_unstale":"2024-09-10T21:07:11.487036+0000","last_undegraded":"2024-09-10T21:07:11.487036+0000","last_fullsized":"2024-09-10T21:07:11.487036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:25.378796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988142+0000","last_change":"2024-09-10T21:07:08.997562+0000","last_active":"2024-09-10T21:07:09.988142+0000","last_peered":"2024-09-10T21:07:09.988142+0000","last_clean":"2024-09-10T21:07:09.988142+0000","last_became_active":"2024-09-10T21:07:08.997293+0000","last_became_peered":"2024-09-10T21:07:08.997293+0000","last_unstale":"2024-09-10T21:07:09.988142+0000","last_undegraded":"2024-09-10T21:07:09.988142+0000","last_fullsized":"2024-09-10T21:07:09.988142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:33.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982325+0000","last_change":"2024-09-10T21:07:07.977927+0000","last_active":"2024-09-10T21:07:09.982325+0000","last_peered":"2024-09-10T21:07:09.982325+0000","last_clean":"2024-09-10T21:07:09.982325+0000","last_became_active":"2024-09-10T21:07:07.976343+0000","last_became_peered":"2024-09-10T21:07:07.976343+0000","last_unstale":"2024-09-10T21:07:09.982325+0000","last_undegraded":"2024-09-10T21:07:09.982325+0000","last_fullsized":"2024-09-10T21:07:09.982325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:13.035700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979032+0000","last_change":"2024-09-10T21:07:08.981362+0000","last_active":"2024-09-10T21:07:11.979032+0000","last_peered":"2024-09-10T21:07:11.979032+0000","last_clean":"2024-09-10T21:07:11.979032+0000","last_became_active":"2024-09-10T21:07:08.981095+0000","last_became_peered":"2024-09-10T21:07:08.981095+0000","last_unstale":"2024-09-10T21:07:11.979032+0000","last_undegraded":"2024-09-10T21:07:11.979032+0000","last_fullsized":"2024-09-10T21:07:11.979032+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:28.167710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979231+0000","last_change":"2024-09-10T21:07:07.974482+0000","last_active":"2024-09-10T21:07:11.979231+0000","last_peered":"2024-09-10T21:07:11.979231+0000","last_clean":"2024-09-10T21:07:11.979231+0000","last_became_active":"2024-09-10T21:07:07.974215+0000","last_became_peered":"2024-09-10T21:07:07.974215+0000","last_unstale":"2024-09-10T21:07:11.979231+0000","last_undegraded":"2024-09-10T21:07:11.979231+0000","last_fullsized":"2024-09-10T21:07:11.979231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:07.774238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982188+0000","last_change":"2024-09-10T21:07:08.990378+0000","last_active":"2024-09-10T21:07:09.982188+0000","last_peered":"2024-09-10T21:07:09.982188+0000","last_clean":"2024-09-10T21:07:09.982188+0000","last_became_active":"2024-09-10T21:07:08.990072+0000","last_became_peered":"2024-09-10T21:07:08.990072+0000","last_unstale":"2024-09-10T21:07:09.982188+0000","last_undegraded":"2024-09-10T21:07:09.982188+0000","last_fullsized":"2024-09-10T21:07:09.982188+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:58.604705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982138+0000","last_change":"2024-09-10T21:07:07.975095+0000","last_active":"2024-09-10T21:07:09.982138+0000","last_peered":"2024-09-10T21:07:09.982138+0000","last_clean":"2024-09-10T21:07:09.982138+0000","last_became_active":"2024-09-10T21:07:07.974845+0000","last_became_peered":"2024-09-10T21:07:07.974845+0000","last_unstale":"2024-09-10T21:07:09.982138+0000","last_undegraded":"2024-09-10T21:07:09.982138+0000","last_fullsized":"2024-09-10T21:07:09.982138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:31.956032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.980001+0000","last_change":"2024-09-10T21:07:08.982133+0000","last_active":"2024-09-10T21:07:11.980001+0000","last_peered":"2024-09-10T21:07:11.980001+0000","last_clean":"2024-09-10T21:07:11.980001+0000","last_became_active":"2024-09-10T21:07:08.981870+0000","last_became_peered":"2024-09-10T21:07:08.981870+0000","last_unstale":"2024-09-10T21:07:11.980001+0000","last_undegraded":"2024-09-10T21:07:11.980001+0000","last_fullsized":"2024-09-10T21:07:11.980001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:07.394025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979684+0000","last_change":"2024-09-10T21:07:07.980009+0000","last_active":"2024-09-10T21:07:11.979684+0000","last_peered":"2024-09-10T21:07:11.979684+0000","last_clean":"2024-09-10T21:07:11.979684+0000","last_became_active":"2024-09-10T21:07:07.979733+0000","last_became_peered":"2024-09-10T21:07:07.979733+0000","last_unstale":"2024-09-10T21:07:11.979684+0000","last_undegraded":"2024-09-10T21:07:11.979684+0000","last_fullsized":"2024-09-10T21:07:11.979684+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:34.698327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.487137+0000","last_change":"2024-09-10T21:07:08.986736+0000","last_active":"2024-09-10T21:07:11.487137+0000","last_peered":"2024-09-10T21:07:11.487137+0000","last_clean":"2024-09-10T21:07:11.487137+0000","last_became_active":"2024-09-10T21:07:08.986446+0000","last_became_peered":"2024-09-10T21:07:08.986446+0000","last_unstale":"2024-09-10T21:07:11.487137+0000","last_undegraded":"2024-09-10T21:07:11.487137+0000","last_fullsized":"2024-09-10T21:07:11.487137+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:22.482940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979394+0000","last_change":"2024-09-10T21:07:07.976156+0000","last_active":"2024-09-10T21:07:11.979394+0000","last_peered":"2024-09-10T21:07:11.979394+0000","last_clean":"2024-09-10T21:07:11.979394+0000","last_became_active":"2024-09-10T21:07:07.975900+0000","last_became_peered":"2024-09-10T21:07:07.975900+0000","last_unstale":"2024-09-10T21:07:11.979394+0000","last_undegraded":"2024-09-10T21:07:11.979394+0000","last_fullsized":"2024-09-10T21:07:11.979394+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:58.074407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979837+0000","last_change":"2024-09-10T21:07:09.002670+0000","last_active":"2024-09-10T21:07:11.979837+0000","last_peered":"2024-09-10T21:07:11.979837+0000","last_clean":"2024-09-10T21:07:11.979837+0000","last_became_active":"2024-09-10T21:07:09.002402+0000","last_became_peered":"2024-09-10T21:07:09.002402+0000","last_unstale":"2024-09-10T21:07:11.979837+0000","last_undegraded":"2024-09-10T21:07:11.979837+0000","last_fullsized":"2024-09-10T21:07:11.979837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:23:06.536654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979200+0000","last_change":"2024-09-10T21:07:07.980159+0000","last_active":"2024-09-10T21:07:11.979200+0000","last_peered":"2024-09-10T21:07:11.979200+0000","last_clean":"2024-09-10T21:07:11.979200+0000","last_became_active":"2024-09-10T21:07:07.977260+0000","last_became_peered":"2024-09-10T21:07:07.977260+0000","last_unstale":"2024-09-10T21:07:11.979200+0000","last_undegraded":"2024-09-10T21:07:11.979200+0000","last_fullsized":"2024-09-10T21:07:11.979200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:56:02.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982844+0000","last_change":"2024-09-10T21:07:08.992058+0000","last_active":"2024-09-10T21:07:09.982844+0000","last_peered":"2024-09-10T21:07:09.982844+0000","last_clean":"2024-09-10T21:07:09.982844+0000","last_became_active":"2024-09-10T21:07:08.991804+0000","last_became_peered":"2024-09-10T21:07:08.991804+0000","last_unstale":"2024-09-10T21:07:09.982844+0000","last_undegraded":"2024-09-10T21:07:09.982844+0000","last_fullsized":"2024-09-10T21:07:09.982844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:57.986096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.980086+0000","last_change":"2024-09-10T21:07:07.979647+0000","last_active":"2024-09-10T21:07:11.980086+0000","last_peered":"2024-09-10T21:07:11.980086+0000","last_clean":"2024-09-10T21:07:11.980086+0000","last_became_active":"2024-09-10T21:07:07.979160+0000","last_became_peered":"2024-09-10T21:07:07.979160+0000","last_unstale":"2024-09-10T21:07:11.980086+0000","last_undegraded":"2024-09-10T21:07:11.980086+0000","last_fullsized":"2024-09-10T21:07:11.980086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:57.596670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979853+0000","last_change":"2024-09-10T21:07:08.984593+0000","last_active":"2024-09-10T21:07:11.979853+0000","last_peered":"2024-09-10T21:07:11.979853+0000","last_clean":"2024-09-10T21:07:11.979853+0000","last_became_active":"2024-09-10T21:07:08.983212+0000","last_became_peered":"2024-09-10T21:07:08.983212+0000","last_unstale":"2024-09-10T21:07:11.979853+0000","last_undegraded":"2024-09-10T21:07:11.979853+0000","last_fullsized":"2024-09-10T21:07:11.979853+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:25.745004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979264+0000","last_change":"2024-09-10T21:07:07.975372+0000","last_active":"2024-09-10T21:07:11.979264+0000","last_peered":"2024-09-10T21:07:11.979264+0000","last_clean":"2024-09-10T21:07:11.979264+0000","last_became_active":"2024-09-10T21:07:07.972536+0000","last_became_peered":"2024-09-10T21:07:07.972536+0000","last_unstale":"2024-09-10T21:07:11.979264+0000","last_undegraded":"2024-09-10T21:07:11.979264+0000","last_fullsized":"2024-09-10T21:07:11.979264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982321+0000","last_change":"2024-09-10T21:07:08.996216+0000","last_active":"2024-09-10T21:07:09.982321+0000","last_peered":"2024-09-10T21:07:09.982321+0000","last_clean":"2024-09-10T21:07:09.982321+0000","last_became_active":"2024-09-10T21:07:08.995845+0000","last_became_peered":"2024-09-10T21:07:08.995845+0000","last_unstale":"2024-09-10T21:07:09.982321+0000","last_undegraded":"2024-09-10T21:07:09.982321+0000","last_fullsized":"2024-09-10T21:07:09.982321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:08.782273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981739+0000","last_change":"2024-09-10T21:07:07.974580+0000","last_active":"2024-09-10T21:07:09.981739+0000","last_peered":"2024-09-10T21:07:09.981739+0000","last_clean":"2024-09-10T21:07:09.981739+0000","last_became_active":"2024-09-10T21:07:07.974287+0000","last_became_peered":"2024-09-10T21:07:07.974287+0000","last_unstale":"2024-09-10T21:07:09.981739+0000","last_undegraded":"2024-09-10T21:07:09.981739+0000","last_fullsized":"2024-09-10T21:07:09.981739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:43.257928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988494+0000","last_change":"2024-09-10T21:07:08.990713+0000","last_active":"2024-09-10T21:07:09.988494+0000","last_peered":"2024-09-10T21:07:09.988494+0000","last_clean":"2024-09-10T21:07:09.988494+0000","last_became_active":"2024-09-10T21:07:08.990447+0000","last_became_peered":"2024-09-10T21:07:08.990447+0000","last_unstale":"2024-09-10T21:07:09.988494+0000","last_undegraded":"2024-09-10T21:07:09.988494+0000","last_fullsized":"2024-09-10T21:07:09.988494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:45.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979046+0000","last_change":"2024-09-10T21:07:07.982710+0000","last_active":"2024-09-10T21:07:11.979046+0000","last_peered":"2024-09-10T21:07:11.979046+0000","last_clean":"2024-09-10T21:07:11.979046+0000","last_became_active":"2024-09-10T21:07:07.982189+0000","last_became_peered":"2024-09-10T21:07:07.982189+0000","last_unstale":"2024-09-10T21:07:11.979046+0000","last_undegraded":"2024-09-10T21:07:11.979046+0000","last_fullsized":"2024-09-10T21:07:11.979046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:21.481889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983543+0000","last_change":"2024-09-10T21:07:09.003185+0000","last_active":"2024-09-10T21:07:09.983543+0000","last_peered":"2024-09-10T21:07:09.983543+0000","last_clean":"2024-09-10T21:07:09.983543+0000","last_became_active":"2024-09-10T21:07:09.002210+0000","last_became_peered":"2024-09-10T21:07:09.002210+0000","last_unstale":"2024-09-10T21:07:09.983543+0000","last_undegraded":"2024-09-10T21:07:09.983543+0000","last_fullsized":"2024-09-10T21:07:09.983543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:04.363218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.487060+0000","last_change":"2024-09-10T21:07:07.977268+0000","last_active":"2024-09-10T21:07:11.487060+0000","last_peered":"2024-09-10T21:07:11.487060+0000","last_clean":"2024-09-10T21:07:11.487060+0000","last_became_active":"2024-09-10T21:07:07.977016+0000","last_became_peered":"2024-09-10T21:07:07.977016+0000","last_unstale":"2024-09-10T21:07:11.487060+0000","last_undegraded":"2024-09-10T21:07:11.487060+0000","last_fullsized":"2024-09-10T21:07:11.487060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:09.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982259+0000","last_change":"2024-09-10T21:07:08.996569+0000","last_active":"2024-09-10T21:07:09.982259+0000","last_peered":"2024-09-10T21:07:09.982259+0000","last_clean":"2024-09-10T21:07:09.982259+0000","last_became_active":"2024-09-10T21:07:08.996285+0000","last_became_peered":"2024-09-10T21:07:08.996285+0000","last_unstale":"2024-09-10T21:07:09.982259+0000","last_undegraded":"2024-09-10T21:07:09.982259+0000","last_fullsized":"2024-09-10T21:07:09.982259+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:35.706362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982755+0000","last_change":"2024-09-10T21:07:07.975307+0000","last_active":"2024-09-10T21:07:09.982755+0000","last_peered":"2024-09-10T21:07:09.982755+0000","last_clean":"2024-09-10T21:07:09.982755+0000","last_became_active":"2024-09-10T21:07:07.975034+0000","last_became_peered":"2024-09-10T21:07:07.975034+0000","last_unstale":"2024-09-10T21:07:09.982755+0000","last_undegraded":"2024-09-10T21:07:09.982755+0000","last_fullsized":"2024-09-10T21:07:09.982755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:59.494549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982671+0000","last_change":"2024-09-10T21:07:08.987536+0000","last_active":"2024-09-10T21:07:09.982671+0000","last_peered":"2024-09-10T21:07:09.982671+0000","last_clean":"2024-09-10T21:07:09.982671+0000","last_became_active":"2024-09-10T21:07:08.987218+0000","last_became_peered":"2024-09-10T21:07:08.987218+0000","last_unstale":"2024-09-10T21:07:09.982671+0000","last_undegraded":"2024-09-10T21:07:09.982671+0000","last_fullsized":"2024-09-10T21:07:09.982671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:16.349411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979505+0000","last_change":"2024-09-10T21:07:07.975529+0000","last_active":"2024-09-10T21:07:11.979505+0000","last_peered":"2024-09-10T21:07:11.979505+0000","last_clean":"2024-09-10T21:07:11.979505+0000","last_became_active":"2024-09-10T21:07:07.974601+0000","last_became_peered":"2024-09-10T21:07:07.974601+0000","last_unstale":"2024-09-10T21:07:11.979505+0000","last_undegraded":"2024-09-10T21:07:11.979505+0000","last_fullsized":"2024-09-10T21:07:11.979505+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:15.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982837+0000","last_change":"2024-09-10T21:07:08.994668+0000","last_active":"2024-09-10T21:07:09.982837+0000","last_peered":"2024-09-10T21:07:09.982837+0000","last_clean":"2024-09-10T21:07:09.982837+0000","last_became_active":"2024-09-10T21:07:08.994384+0000","last_became_peered":"2024-09-10T21:07:08.994384+0000","last_unstale":"2024-09-10T21:07:09.982837+0000","last_undegraded":"2024-09-10T21:07:09.982837+0000","last_fullsized":"2024-09-10T21:07:09.982837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:14.061765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983445+0000","last_change":"2024-09-10T21:07:07.984389+0000","last_active":"2024-09-10T21:07:09.983445+0000","last_peered":"2024-09-10T21:07:09.983445+0000","last_clean":"2024-09-10T21:07:09.983445+0000","last_became_active":"2024-09-10T21:07:07.983958+0000","last_became_peered":"2024-09-10T21:07:07.983958+0000","last_unstale":"2024-09-10T21:07:09.983445+0000","last_undegraded":"2024-09-10T21:07:09.983445+0000","last_fullsized":"2024-09-10T21:07:09.983445+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:38.916517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.230218+0000","last_change":"2024-09-10T21:07:08.989112+0000","last_active":"2024-09-10T21:07:11.230218+0000","last_peered":"2024-09-10T21:07:11.230218+0000","last_clean":"2024-09-10T21:07:11.230218+0000","last_became_active":"2024-09-10T21:07:08.988761+0000","last_became_peered":"2024-09-10T21:07:08.988761+0000","last_unstale":"2024-09-10T21:07:11.230218+0000","last_undegraded":"2024-09-10T21:07:11.230218+0000","last_fullsized":"2024-09-10T21:07:11.230218+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:11.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.229939+0000","last_change":"2024-09-10T21:07:07.980137+0000","last_active":"2024-09-10T21:07:11.229939+0000","last_peered":"2024-09-10T21:07:11.229939+0000","last_clean":"2024-09-10T21:07:11.229939+0000","last_became_active":"2024-09-10T21:07:07.979323+0000","last_became_peered":"2024-09-10T21:07:07.979323+0000","last_unstale":"2024-09-10T21:07:11.229939+0000","last_undegraded":"2024-09-10T21:07:11.229939+0000","last_fullsized":"2024-09-10T21:07:11.229939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:29.008858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.978805+0000","last_change":"2024-09-10T21:07:08.985488+0000","last_active":"2024-09-10T21:07:11.978805+0000","last_peered":"2024-09-10T21:07:11.978805+0000","last_clean":"2024-09-10T21:07:11.978805+0000","last_became_active":"2024-09-10T21:07:08.985240+0000","last_became_peered":"2024-09-10T21:07:08.985240+0000","last_unstale":"2024-09-10T21:07:11.978805+0000","last_undegraded":"2024-09-10T21:07:11.978805+0000","last_fullsized":"2024-09-10T21:07:11.978805+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:28.190439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.230050+0000","last_change":"2024-09-10T21:07:07.981367+0000","last_active":"2024-09-10T21:07:11.230050+0000","last_peered":"2024-09-10T21:07:11.230050+0000","last_clean":"2024-09-10T21:07:11.230050+0000","last_became_active":"2024-09-10T21:07:07.981095+0000","last_became_peered":"2024-09-10T21:07:07.981095+0000","last_unstale":"2024-09-10T21:07:11.230050+0000","last_undegraded":"2024-09-10T21:07:11.230050+0000","last_fullsized":"2024-09-10T21:07:11.230050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:14.629281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979257+0000","last_change":"2024-09-10T21:07:08.994822+0000","last_active":"2024-09-10T21:07:11.979257+0000","last_peered":"2024-09-10T21:07:11.979257+0000","last_clean":"2024-09-10T21:07:11.979257+0000","last_became_active":"2024-09-10T21:07:08.994580+0000","last_became_peered":"2024-09-10T21:07:08.994580+0000","last_unstale":"2024-09-10T21:07:11.979257+0000","last_undegraded":"2024-09-10T21:07:11.979257+0000","last_fullsized":"2024-09-10T21:07:11.979257+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:23.598752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981844+0000","last_change":"2024-09-10T21:07:07.970920+0000","last_active":"2024-09-10T21:07:09.981844+0000","last_peered":"2024-09-10T21:07:09.981844+0000","last_clean":"2024-09-10T21:07:09.981844+0000","last_became_active":"2024-09-10T21:07:07.970301+0000","last_became_peered":"2024-09-10T21:07:07.970301+0000","last_unstale":"2024-09-10T21:07:09.981844+0000","last_undegraded":"2024-09-10T21:07:09.981844+0000","last_fullsized":"2024-09-10T21:07:09.981844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:54.822209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988171+0000","last_change":"2024-09-10T21:07:08.990744+0000","last_active":"2024-09-10T21:07:09.988171+0000","last_peered":"2024-09-10T21:07:09.988171+0000","last_clean":"2024-09-10T21:07:09.988171+0000","last_became_active":"2024-09-10T21:07:08.989163+0000","last_became_peered":"2024-09-10T21:07:08.989163+0000","last_unstale":"2024-09-10T21:07:09.988171+0000","last_undegraded":"2024-09-10T21:07:09.988171+0000","last_fullsized":"2024-09-10T21:07:09.988171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:07.499470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982544+0000","last_change":"2024-09-10T21:07:07.974215+0000","last_active":"2024-09-10T21:07:09.982544+0000","last_peered":"2024-09-10T21:07:09.982544+0000","last_clean":"2024-09-10T21:07:09.982544+0000","last_became_active":"2024-09-10T21:07:07.973960+0000","last_became_peered":"2024-09-10T21:07:07.973960+0000","last_unstale":"2024-09-10T21:07:09.982544+0000","last_undegraded":"2024-09-10T21:07:09.982544+0000","last_fullsized":"2024-09-10T21:07:09.982544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:27.040936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979374+0000","last_change":"2024-09-10T21:07:09.004117+0000","last_active":"2024-09-10T21:07:11.979374+0000","last_peered":"2024-09-10T21:07:11.979374+0000","last_clean":"2024-09-10T21:07:11.979374+0000","last_became_active":"2024-09-10T21:07:09.003435+0000","last_became_peered":"2024-09-10T21:07:09.003435+0000","last_unstale":"2024-09-10T21:07:11.979374+0000","last_undegraded":"2024-09-10T21:07:11.979374+0000","last_fullsized":"2024-09-10T21:07:11.979374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:18.800689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981579+0000","last_change":"2024-09-10T21:07:07.975653+0000","last_active":"2024-09-10T21:07:09.981579+0000","last_peered":"2024-09-10T21:07:09.981579+0000","last_clean":"2024-09-10T21:07:09.981579+0000","last_became_active":"2024-09-10T21:07:07.975383+0000","last_became_peered":"2024-09-10T21:07:07.975383+0000","last_unstale":"2024-09-10T21:07:09.981579+0000","last_undegraded":"2024-09-10T21:07:09.981579+0000","last_fullsized":"2024-09-10T21:07:09.981579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:24.484277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983577+0000","last_change":"2024-09-10T21:07:09.003571+0000","last_active":"2024-09-10T21:07:09.983577+0000","last_peered":"2024-09-10T21:07:09.983577+0000","last_clean":"2024-09-10T21:07:09.983577+0000","last_became_active":"2024-09-10T21:07:09.003282+0000","last_became_peered":"2024-09-10T21:07:09.003282+0000","last_unstale":"2024-09-10T21:07:09.983577+0000","last_undegraded":"2024-09-10T21:07:09.983577+0000","last_fullsized":"2024-09-10T21:07:09.983577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:20.842594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979676+0000","last_change":"2024-09-10T21:07:07.982369+0000","last_active":"2024-09-10T21:07:11.979676+0000","last_peered":"2024-09-10T21:07:11.979676+0000","last_clean":"2024-09-10T21:07:11.979676+0000","last_became_active":"2024-09-10T21:07:07.982077+0000","last_became_peered":"2024-09-10T21:07:07.982077+0000","last_unstale":"2024-09-10T21:07:11.979676+0000","last_undegraded":"2024-09-10T21:07:11.979676+0000","last_fullsized":"2024-09-10T21:07:11.979676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:40.539770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988694+0000","last_change":"2024-09-10T21:07:08.989455+0000","last_active":"2024-09-10T21:07:09.988694+0000","last_peered":"2024-09-10T21:07:09.988694+0000","last_clean":"2024-09-10T21:07:09.988694+0000","last_became_active":"2024-09-10T21:07:08.989206+0000","last_became_peered":"2024-09-10T21:07:08.989206+0000","last_unstale":"2024-09-10T21:07:09.988694+0000","last_undegraded":"2024-09-10T21:07:09.988694+0000","last_fullsized":"2024-09-10T21:07:09.988694+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:16.346805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.987453+0000","last_change":"2024-09-10T21:07:07.984174+0000","last_active":"2024-09-10T21:07:09.987453+0000","last_peered":"2024-09-10T21:07:09.987453+0000","last_clean":"2024-09-10T21:07:09.987453+0000","last_became_active":"2024-09-10T21:07:07.983898+0000","last_became_peered":"2024-09-10T21:07:07.983898+0000","last_unstale":"2024-09-10T21:07:09.987453+0000","last_undegraded":"2024-09-10T21:07:09.987453+0000","last_fullsized":"2024-09-10T21:07:09.987453+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:27.972473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.230105+0000","last_change":"2024-09-10T21:07:08.991284+0000","last_active":"2024-09-10T21:07:11.230105+0000","last_peered":"2024-09-10T21:07:11.230105+0000","last_clean":"2024-09-10T21:07:11.230105+0000","last_became_active":"2024-09-10T21:07:08.991010+0000","last_became_peered":"2024-09-10T21:07:08.991010+0000","last_unstale":"2024-09-10T21:07:11.230105+0000","last_undegraded":"2024-09-10T21:07:11.230105+0000","last_fullsized":"2024-09-10T21:07:11.230105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:35.802436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.983503+0000","last_change":"2024-09-10T21:07:07.982520+0000","last_active":"2024-09-10T21:07:09.983503+0000","last_peered":"2024-09-10T21:07:09.983503+0000","last_clean":"2024-09-10T21:07:09.983503+0000","last_became_active":"2024-09-10T21:07:07.982215+0000","last_became_peered":"2024-09-10T21:07:07.982215+0000","last_unstale":"2024-09-10T21:07:09.983503+0000","last_undegraded":"2024-09-10T21:07:09.983503+0000","last_fullsized":"2024-09-10T21:07:09.983503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:38.024808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982590+0000","last_change":"2024-09-10T21:07:09.000771+0000","last_active":"2024-09-10T21:07:09.982590+0000","last_peered":"2024-09-10T21:07:09.982590+0000","last_clean":"2024-09-10T21:07:09.982590+0000","last_became_active":"2024-09-10T21:07:09.000225+0000","last_became_peered":"2024-09-10T21:07:09.000225+0000","last_unstale":"2024-09-10T21:07:09.982590+0000","last_undegraded":"2024-09-10T21:07:09.982590+0000","last_fullsized":"2024-09-10T21:07:09.982590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:54.739100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979550+0000","last_change":"2024-09-10T21:07:07.972550+0000","last_active":"2024-09-10T21:07:11.979550+0000","last_peered":"2024-09-10T21:07:11.979550+0000","last_clean":"2024-09-10T21:07:11.979550+0000","last_became_active":"2024-09-10T21:07:07.972258+0000","last_became_peered":"2024-09-10T21:07:07.972258+0000","last_unstale":"2024-09-10T21:07:11.979550+0000","last_undegraded":"2024-09-10T21:07:11.979550+0000","last_fullsized":"2024-09-10T21:07:11.979550+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:09:54.175968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.981812+0000","last_change":"2024-09-10T21:07:08.993085+0000","last_active":"2024-09-10T21:07:09.981812+0000","last_peered":"2024-09-10T21:07:09.981812+0000","last_clean":"2024-09-10T21:07:09.981812+0000","last_became_active":"2024-09-10T21:07:08.992693+0000","last_became_peered":"2024-09-10T21:07:08.992693+0000","last_unstale":"2024-09-10T21:07:09.981812+0000","last_undegraded":"2024-09-10T21:07:09.981812+0000","last_fullsized":"2024-09-10T21:07:09.981812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:29.416774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988406+0000","last_change":"2024-09-10T21:07:07.984281+0000","last_active":"2024-09-10T21:07:09.988406+0000","last_peered":"2024-09-10T21:07:09.988406+0000","last_clean":"2024-09-10T21:07:09.988406+0000","last_became_active":"2024-09-10T21:07:07.983954+0000","last_became_peered":"2024-09-10T21:07:07.983954+0000","last_unstale":"2024-09-10T21:07:09.988406+0000","last_undegraded":"2024-09-10T21:07:09.988406+0000","last_fullsized":"2024-09-10T21:07:09.988406+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:15.341376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979161+0000","last_change":"2024-09-10T21:07:08.982222+0000","last_active":"2024-09-10T21:07:11.979161+0000","last_peered":"2024-09-10T21:07:11.979161+0000","last_clean":"2024-09-10T21:07:11.979161+0000","last_became_active":"2024-09-10T21:07:08.981942+0000","last_became_peered":"2024-09-10T21:07:08.981942+0000","last_unstale":"2024-09-10T21:07:11.979161+0000","last_undegraded":"2024-09-10T21:07:11.979161+0000","last_fullsized":"2024-09-10T21:07:11.979161+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:27.302351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979096+0000","last_change":"2024-09-10T21:07:07.982359+0000","last_active":"2024-09-10T21:07:11.979096+0000","last_peered":"2024-09-10T21:07:11.979096+0000","last_clean":"2024-09-10T21:07:11.979096+0000","last_became_active":"2024-09-10T21:07:07.982087+0000","last_became_peered":"2024-09-10T21:07:07.982087+0000","last_unstale":"2024-09-10T21:07:11.979096+0000","last_undegraded":"2024-09-10T21:07:11.979096+0000","last_fullsized":"2024-09-10T21:07:11.979096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:44.164885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988331+0000","last_change":"2024-09-10T21:07:08.994477+0000","last_active":"2024-09-10T21:07:09.988331+0000","last_peered":"2024-09-10T21:07:09.988331+0000","last_clean":"2024-09-10T21:07:09.988331+0000","last_became_active":"2024-09-10T21:07:08.994228+0000","last_became_peered":"2024-09-10T21:07:08.994228+0000","last_unstale":"2024-09-10T21:07:09.988331+0000","last_undegraded":"2024-09-10T21:07:09.988331+0000","last_fullsized":"2024-09-10T21:07:09.988331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:15.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.980063+0000","last_change":"2024-09-10T21:07:07.977266+0000","last_active":"2024-09-10T21:07:11.980063+0000","last_peered":"2024-09-10T21:07:11.980063+0000","last_clean":"2024-09-10T21:07:11.980063+0000","last_became_active":"2024-09-10T21:07:07.976927+0000","last_became_peered":"2024-09-10T21:07:07.976927+0000","last_unstale":"2024-09-10T21:07:11.980063+0000","last_undegraded":"2024-09-10T21:07:11.980063+0000","last_fullsized":"2024-09-10T21:07:11.980063+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:04.086693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:11.979517+0000","last_change":"2024-09-10T21:07:08.996299+0000","last_active":"2024-09-10T21:07:11.979517+0000","last_peered":"2024-09-10T21:07:11.979517+0000","last_clean":"2024-09-10T21:07:11.979517+0000","last_became_active":"2024-09-10T21:07:08.995907+0000","last_became_peered":"2024-09-10T21:07:08.995907+0000","last_unstale":"2024-09-10T21:07:11.979517+0000","last_undegraded":"2024-09-10T21:07:11.979517+0000","last_fullsized":"2024-09-10T21:07:11.979517+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:07.951697+0000","last_clean_scrub_stamp":"2024-09-10T21:07:07.951697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:35.145229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.988421+0000","last_change":"2024-09-10T21:07:07.979476+0000","last_active":"2024-09-10T21:07:09.988421+0000","last_peered":"2024-09-10T21:07:09.988421+0000","last_clean":"2024-09-10T21:07:09.988421+0000","last_became_active":"2024-09-10T21:07:07.979192+0000","last_became_peered":"2024-09-10T21:07:07.979192+0000","last_unstale":"2024-09-10T21:07:09.988421+0000","last_undegraded":"2024-09-10T21:07:09.988421+0000","last_fullsized":"2024-09-10T21:07:09.988421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:07:06.943662+0000","last_clean_scrub_stamp":"2024-09-10T21:07:06.943662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:25.005206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982211+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:09.982211+0000","last_peered":"2024-09-10T21:07:09.982211+0000","last_clean":"2024-09-10T21:07:09.982211+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:09.982211+0000","last_undegraded":"2024-09-10T21:07:09.982211+0000","last_fullsized":"2024-09-10T21:07:09.982211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":201977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1064960,"data_stored":790631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":791191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:18.272 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T21:07:18.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T21:07:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.470+0000 7f9c80c00640 1 -- 172.21.15.100:0/2576445987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60003a70 msgr2=0x7f9c60003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.470+0000 7f9c80c00640 1 --2- 172.21.15.100:0/2576445987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c60003a70 0x7f9c60003e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009ed0 tx=0x7f9c60005830 comp rx=0 tx=0).stop 2024-09-10T21:07:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.470+0000 7f9c7be00640 1 -- 172.21.15.100:0/2576445987 reap_dead start 2024-09-10T21:07:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.470+0000 7f9c80c00640 1 -- 172.21.15.100:0/2576445987 shutdown_connections 2024-09-10T21:07:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.470+0000 7f9c80c00640 1 -- 172.21.15.100:0/2576445987 >> 172.21.15.100:0/2576445987 conn(0x7f9c7c0b12e0 msgr2=0x7f9c7c0b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.470+0000 7f9c80c00640 1 -- 172.21.15.100:0/2576445987 shutdown_connections 2024-09-10T21:07:18.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.470+0000 7f9c80c00640 1 -- 172.21.15.100:0/2576445987 wait complete. 2024-09-10T21:07:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.472+0000 7f9c80c00640 1 Processor -- start 2024-09-10T21:07:18.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.472+0000 7f9c80c00640 1 -- start start 2024-09-10T21:07:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c80c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9c60003a70 0x7f9c7c073d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c80c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c7c154580 0x7f9c7c1f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c80c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c7c072b00 0x7f9c7c151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c80c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c15ff00 con 0x7f9c7c154580 2024-09-10T21:07:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c80c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c15fd80 con 0x7f9c7c072b00 2024-09-10T21:07:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c80c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9c7c1f3960 con 0x7f9c60003a70 2024-09-10T21:07:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c7c154580 0x7f9c7c1f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:18.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c7c154580 0x7f9c7c1f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32974/0 (socket says 172.21.15.100:32974) 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7aa00640 1 -- 172.21.15.100:0/3417942406 learned_addr learned my addr 172.21.15.100:0/3417942406 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7b400640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9c60003a70 0x7f9c7c073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7be00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c7c072b00 0x7f9c7c151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7aa00640 1 -- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9c60003a70 msgr2=0x7f9c7c073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7aa00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9c60003a70 0x7f9c7c073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7aa00640 1 -- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c7c072b00 msgr2=0x7f9c7c151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7aa00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c7c072b00 0x7f9c7c151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7aa00640 1 -- 172.21.15.100:0/3417942406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7c1f33a0 con 0x7f9c7c154580 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.473+0000 7f9c7be00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c7c072b00 0x7f9c7c151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.474+0000 7f9c7b400640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9c60003a70 0x7f9c7c073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.474+0000 7f9c7aa00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c7c154580 0x7f9c7c1f2a30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800e5c0 tx=0x7f9c680019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.474+0000 7f9c73400640 1 -- 172.21.15.100:0/3417942406 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68015070 con 0x7f9c7c154580 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.474+0000 7f9c73400640 1 -- 172.21.15.100:0/3417942406 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c6800ca00 con 0x7f9c7c154580 2024-09-10T21:07:18.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.474+0000 7f9c73400640 1 -- 172.21.15.100:0/3417942406 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6800ce50 con 0x7f9c7c154580 2024-09-10T21:07:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.474+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7c1f3680 con 0x7f9c7c154580 2024-09-10T21:07:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.474+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7c0725e0 con 0x7f9c7c154580 2024-09-10T21:07:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.475+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c7c0cd5b0 con 0x7f9c7c154580 2024-09-10T21:07:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.476+0000 7f9c73400640 1 -- 172.21.15.100:0/3417942406 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9c68011460 con 0x7f9c7c154580 2024-09-10T21:07:18.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.477+0000 7f9c73400640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9c5c078110 0x7f9c5c07a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.477+0000 7f9c73400640 1 -- 172.21.15.100:0/3417942406 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f9c6809a630 con 0x7f9c7c154580 2024-09-10T21:07:18.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.478+0000 7f9c7b400640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9c5c078110 0x7f9c5c07a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:18.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.478+0000 7f9c7b400640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9c5c078110 0x7f9c5c07a5d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c035000 tx=0x7f9c6c004a40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:18.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.481+0000 7f9c73400640 1 -- 172.21.15.100:0/3417942406 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9c7c160540 con 0x7f9c7c154580 2024-09-10T21:07:18.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.731+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9c7c0727b0 con 0x7f9c7c154580 2024-09-10T21:07:19.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.734+0000 7f9c73400640 1 -- 172.21.15.100:0/3417942406 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f9c68062f90 con 0x7f9c7c154580 2024-09-10T21:07:19.006 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-09-10T21:07:19.006 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCBtOBmKe35LRAA/ypsjneLjq8SDPXWynEDQw== 2024-09-10T21:07:19.006 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-09-10T21:07:19.006 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-09-10T21:07:19.006 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T21:07:19.008 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-09-10T21:07:19.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9c5c078110 msgr2=0x7f9c5c07a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9c5c078110 0x7f9c5c07a5d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c035000 tx=0x7f9c6c004a40 comp rx=0 tx=0).stop 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c7c154580 msgr2=0x7f9c7c1f2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c7c154580 0x7f9c7c1f2a30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800e5c0 tx=0x7f9c680019f0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 shutdown_connections 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f9c5c078110 0x7f9c5c07a5d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c7c072b00 0x7f9c7c151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c7c154580 0x7f9c7c1f2a30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 --2- 172.21.15.100:0/3417942406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9c60003a70 0x7f9c7c073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.736+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 >> 172.21.15.100:0/3417942406 conn(0x7f9c7c0b12e0 msgr2=0x7f9c7c0ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.737+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 shutdown_connections 2024-09-10T21:07:19.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:18.737+0000 7f9c80c00640 1 -- 172.21.15.100:0/3417942406 wait complete. 2024-09-10T21:07:19.010 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:07:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.164+0000 7fbe06a00640 1 -- 172.21.15.100:0/3891406458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbe0006eb60 msgr2=0x7fbe0006efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.164+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3891406458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbe0006eb60 0x7fbe0006efd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009830 tx=0x7fbdf802a5a0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.164+0000 7fbe06a00640 1 -- 172.21.15.100:0/3891406458 shutdown_connections 2024-09-10T21:07:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.164+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3891406458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbe0006eb60 0x7fbe0006efd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.164+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3891406458 >> v2:172.21.15.130:3300/0 conn(0x7fbe0015b4d0 0x7fbe0015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.164+0000 7fbe06a00640 1 -- 172.21.15.100:0/3891406458 >> 172.21.15.100:0/3891406458 conn(0x7fbe0006cb50 msgr2=0x7fbe0006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.164+0000 7fbe06a00640 1 -- 172.21.15.100:0/3891406458 shutdown_connections 2024-09-10T21:07:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.164+0000 7fbe06a00640 1 -- 172.21.15.100:0/3891406458 wait complete. 2024-09-10T21:07:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.165+0000 7fbe06a00640 1 Processor -- start 2024-09-10T21:07:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.166+0000 7fbe06a00640 1 -- start start 2024-09-10T21:07:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.166+0000 7fbe06a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe0006eb60 0x7fbe000c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.166+0000 7fbe06a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe000cf810 0x7fbe000ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.166+0000 7fbe06a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbe0015b4d0 0x7fbe000c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.166+0000 7fbe06a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000b2de0 con 0x7fbe000cf810 2024-09-10T21:07:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.166+0000 7fbe06a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000b2c60 con 0x7fbe0006eb60 2024-09-10T21:07:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.166+0000 7fbe06a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbe000b2f60 con 0x7fbe0015b4d0 2024-09-10T21:07:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe000cf810 0x7fbe000ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe000cf810 0x7fbe000ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32986/0 (socket says 172.21.15.100:32986) 2024-09-10T21:07:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 -- 172.21.15.100:0/3004840469 learned_addr learned my addr 172.21.15.100:0/3004840469 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdffe00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe0006eb60 0x7fbe000c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbe04a00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbe0015b4d0 0x7fbe000c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 -- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbe0015b4d0 msgr2=0x7fbe000c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbe0015b4d0 0x7fbe000c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 -- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe0006eb60 msgr2=0x7fbe000c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe0006eb60 0x7fbe000c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 -- 172.21.15.100:0/3004840469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe000c6250 con 0x7fbe000cf810 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.167+0000 7fbdff400640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe000cf810 0x7fbe000ceb70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00c450 tx=0x7fbdec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.168+0000 7fbdf7e00640 1 -- 172.21.15.100:0/3004840469 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0052d0 con 0x7fbe000cf810 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.168+0000 7fbdf7e00640 1 -- 172.21.15.100:0/3004840469 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdec005470 con 0x7fbe000cf810 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.168+0000 7fbdf7e00640 1 -- 172.21.15.100:0/3004840469 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec012870 con 0x7fbe000cf810 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.168+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe000c51b0 con 0x7fbe000cf810 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.168+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe000c5770 con 0x7fbe000cf810 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.169+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe000b3480 con 0x7fbe000cf810 2024-09-10T21:07:19.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.170+0000 7fbdf7e00640 1 -- 172.21.15.100:0/3004840469 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbdec0035f0 con 0x7fbe000cf810 2024-09-10T21:07:19.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.171+0000 7fbdf7e00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbde0077f70 0x7fbde007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.171+0000 7fbdf7e00640 1 -- 172.21.15.100:0/3004840469 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fbdec099990 con 0x7fbe000cf810 2024-09-10T21:07:19.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.172+0000 7fbdffe00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbde0077f70 0x7fbde007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.172+0000 7fbdffe00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbde0077f70 0x7fbde007a430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009a60 tx=0x7fbdf0010040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.175+0000 7fbdf7e00640 1 -- 172.21.15.100:0/3004840469 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbe0015efa0 con 0x7fbe000cf810 2024-09-10T21:07:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.393+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe00075d40 con 0x7fbe000cf810 2024-09-10T21:07:19.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.393+0000 7fbdf7e00640 1 -- 172.21.15.100:0/3004840469 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7fbdec061c10 con 0x7fbe000cf810 2024-09-10T21:07:19.398 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:19.398 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"btime":"2024-09-10T21:07:11:987578+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3760826970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3760826970},{"type":"v1","addr":"172.21.15.100:6834","nonce":3760826970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2104919496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2104919496},{"type":"v1","addr":"172.21.15.130:6837","nonce":2104919496}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2076530872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2076530872},{"type":"v1","addr":"172.21.15.100:6835","nonce":2076530872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:07:08.380674+0000","modified":"2024-09-10T21:07:11.401889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/772903553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":772903553},{"type":"v1","addr":"172.21.15.130:6836","nonce":772903553}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-09-10T21:07:19.399 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbde0077f70 msgr2=0x7fbde007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbde0077f70 0x7fbde007a430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009a60 tx=0x7fbdf0010040 comp rx=0 tx=0).stop 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe000cf810 msgr2=0x7fbe000ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe000cf810 0x7fbe000ceb70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00c450 tx=0x7fbdec00c910 comp rx=0 tx=0).stop 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 shutdown_connections 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbe0015b4d0 0x7fbe000c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe000cf810 0x7fbe000ceb70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbde0077f70 0x7fbde007a430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 --2- 172.21.15.100:0/3004840469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe0006eb60 0x7fbe000c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 >> 172.21.15.100:0/3004840469 conn(0x7fbe0006cb50 msgr2=0x7fbe000b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 shutdown_connections 2024-09-10T21:07:19.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.396+0000 7fbe06a00640 1 -- 172.21.15.100:0/3004840469 wait complete. 2024-09-10T21:07:19.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T21:07:08.380674+0000', 'modified': '2024-09-10T21:07:11.401889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5046}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5046': {'gid': 5046, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6836/772903553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 772903553}, {'type': 'v1', 'addr': '172.21.15.130:6836', 'nonce': 772903553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5046, 'qdb_cluster': [5046]} 2024-09-10T21:07:19.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T21:07:19.819 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T21:07:19.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.976+0000 7fd145e00640 1 -- 172.21.15.100:0/801502058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 msgr2=0x7fd14015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.976+0000 7fd145e00640 1 --2- 172.21.15.100:0/801502058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 0x7fd14015ba60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd130009830 tx=0x7fd13002a480 comp rx=0 tx=0).stop 2024-09-10T21:07:19.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.976+0000 7fd145e00640 1 -- 172.21.15.100:0/801502058 shutdown_connections 2024-09-10T21:07:19.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.976+0000 7fd145e00640 1 --2- 172.21.15.100:0/801502058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1400741e0 0x7fd14015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.976+0000 7fd145e00640 1 --2- 172.21.15.100:0/801502058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 0x7fd14015ba60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.976+0000 7fd145e00640 1 -- 172.21.15.100:0/801502058 >> 172.21.15.100:0/801502058 conn(0x7fd14006cb50 msgr2=0x7fd14006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.976+0000 7fd145e00640 1 -- 172.21.15.100:0/801502058 shutdown_connections 2024-09-10T21:07:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.976+0000 7fd145e00640 1 -- 172.21.15.100:0/801502058 wait complete. 2024-09-10T21:07:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.978+0000 7fd145e00640 1 Processor -- start 2024-09-10T21:07:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.978+0000 7fd145e00640 1 -- start start 2024-09-10T21:07:19.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd145e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1400741e0 0x7fd140144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd145e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 0x7fd1401e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd145e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd14015c750 0x7fd140145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd145e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd1400b29e0 con 0x7fd14015b680 2024-09-10T21:07:19.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd145e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd1400b2860 con 0x7fd14015c750 2024-09-10T21:07:19.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd145e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd1400b2b60 con 0x7fd1400741e0 2024-09-10T21:07:19.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd13e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 0x7fd1401e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd13e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 0x7fd1401e52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33002/0 (socket says 172.21.15.100:33002) 2024-09-10T21:07:19.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd13e000640 1 -- 172.21.15.100:0/3484349155 learned_addr learned my addr 172.21.15.100:0/3484349155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:19.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd13ea00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1400741e0 0x7fd140144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.979+0000 7fd13f400640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd14015c750 0x7fd140145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd13e000640 1 -- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1400741e0 msgr2=0x7fd140144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd13e000640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1400741e0 0x7fd140144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd13e000640 1 -- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd14015c750 msgr2=0x7fd140145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd13e000640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd14015c750 0x7fd140145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd13e000640 1 -- 172.21.15.100:0/3484349155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1400b0520 con 0x7fd14015b680 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd13f400640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd14015c750 0x7fd140145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd13ea00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1400741e0 0x7fd140144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd13e000640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 0x7fd1401e52b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00d950 tx=0x7fd12c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd137400640 1 -- 172.21.15.100:0/3484349155 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c017070 con 0x7fd14015b680 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd137400640 1 -- 172.21.15.100:0/3484349155 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd12c009d20 con 0x7fd14015b680 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd137400640 1 -- 172.21.15.100:0/3484349155 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0106c0 con 0x7fd14015b680 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd145e00640 1 -- 172.21.15.100:0/3484349155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1400b07e0 con 0x7fd14015b680 2024-09-10T21:07:19.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.980+0000 7fd145e00640 1 -- 172.21.15.100:0/3484349155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1400b0da0 con 0x7fd14015b680 2024-09-10T21:07:19.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.983+0000 7fd137400640 1 -- 172.21.15.100:0/3484349155 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd12c010860 con 0x7fd14015b680 2024-09-10T21:07:19.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.984+0000 7fd137400640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd120077f70 0x7fd12007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.984+0000 7fd148cae740 1 Processor -- start 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.984+0000 7fd137400640 1 -- 172.21.15.100:0/3484349155 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd12c09a340 con 0x7fd14015b680 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.984+0000 7fd148cae740 1 -- start start 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.984+0000 7fd13ea00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd120077f70 0x7fd12007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd148cae740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd958b0 0x55fe6fd95c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd148cae740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd50a20 0x55fe6fd94390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd148cae740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd948d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd148cae740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fe6fcd3430 con 0x55fe6fd50fa0 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd148cae740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fe6fcc35d0 con 0x55fe6fd958b0 2024-09-10T21:07:19.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd148cae740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55fe6fcb2a00 con 0x55fe6fd50a20 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd13ea00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd120077f70 0x7fd12007a430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd130034000 tx=0x7fd130004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd13f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd13ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd958b0 0x55fe6fd95c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd13f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd948d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33016/0 (socket says 172.21.15.100:33016) 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd13f400640 1 -- 172.21.15.100:0/729254190 learned_addr learned my addr 172.21.15.100:0/729254190 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.985+0000 7fd13e000640 1 --2- 172.21.15.100:0/729254190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd50a20 0x55fe6fd94390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd13f400640 1 -- 172.21.15.100:0/729254190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd50a20 msgr2=0x55fe6fd94390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd13f400640 1 --2- 172.21.15.100:0/729254190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd50a20 0x55fe6fd94390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd13f400640 1 -- 172.21.15.100:0/729254190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd958b0 msgr2=0x55fe6fd95c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:19.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd13f400640 1 --2- 172.21.15.100:0/729254190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd958b0 0x55fe6fd95c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd13f400640 1 -- 172.21.15.100:0/729254190 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6fc7b520 con 0x55fe6fd50fa0 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd13f400640 1 --2- 172.21.15.100:0/729254190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd948d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd138001ca0 tx=0x7fd138002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0b7b1afb52d269 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd12b400640 1 -- 172.21.15.100:0/729254190 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138019070 con 0x55fe6fd50fa0 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd12b400640 1 -- 172.21.15.100:0/729254190 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd138003b80 con 0x55fe6fd50fa0 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.986+0000 7fd12b400640 1 -- 172.21.15.100:0/729254190 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13800e8c0 con 0x55fe6fd50fa0 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 -- 172.21.15.100:0/729254190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 msgr2=0x55fe6fd948d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 --2- 172.21.15.100:0/729254190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd948d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd138001ca0 tx=0x7fd138002160 comp rx=0 tx=0).stop 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 -- 172.21.15.100:0/729254190 shutdown_connections 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 --2- 172.21.15.100:0/729254190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd948d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 --2- 172.21.15.100:0/729254190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd50a20 0x55fe6fd94390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 --2- 172.21.15.100:0/729254190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd958b0 0x55fe6fd95c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 -- 172.21.15.100:0/729254190 >> 172.21.15.100:0/729254190 conn(0x55fe6fd4bff0 msgr2=0x55fe6fd4fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 -- 172.21.15.100:0/729254190 shutdown_connections 2024-09-10T21:07:19.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.987+0000 7fd148cae740 1 -- 172.21.15.100:0/729254190 wait complete. 2024-09-10T21:07:19.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.988+0000 7fd148cae740 1 -- start start 2024-09-10T21:07:19.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.988+0000 7fd148cae740 1 Processor -- start 2024-09-10T21:07:19.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd148cae740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fda4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd148cae740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd958b0 0x55fe6fd74cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd148cae740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd75580 0x55fe6fd90da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd148cae740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fe6fc59330 con 0x55fe6fd958b0 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd148cae740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fe6fcb6810 con 0x55fe6fd50fa0 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd148cae740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55fe6fa23620 con 0x55fe6fd75580 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd148cae740 10 client.0 _ll_register_callbacks cb 0x55fe6fc5e420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd958b0 0x55fe6fd74cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd958b0 0x55fe6fd74cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33030/0 (socket says 172.21.15.100:33030) 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13e000640 1 -- 172.21.15.100:0/2950983537 learned_addr learned my addr 172.21.15.100:0/2950983537 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13ea00640 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fda4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13f400640 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd75580 0x55fe6fd90da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13e000640 1 -- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd75580 msgr2=0x55fe6fd90da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:20.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13e000640 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd75580 0x55fe6fd90da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13e000640 1 -- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 msgr2=0x55fe6fda4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13e000640 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fda4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13e000640 1 -- 172.21.15.100:0/2950983537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe6fa14850 con 0x55fe6fd958b0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.989+0000 7fd13f400640 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd75580 0x55fe6fd90da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd13e000640 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd958b0 0x55fe6fd74cb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd12c05f810 tx=0x7fd12c061d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1989007c7d13235 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd11fe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd11fe00640 1 -- 172.21.15.100:0/2950983537 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c020040 con 0x55fe6fd958b0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd11fe00640 1 -- 172.21.15.100:0/2950983537 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd12c04d990 con 0x55fe6fd958b0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 1 -- 172.21.15.100:0/2950983537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd138003b80 con 0x55fe6fd958b0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd11fe00640 1 -- 172.21.15.100:0/2950983537 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd12c07c230 con 0x55fe6fd958b0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 10 client.5250 fetch_fsmap learned FSMap version 18 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 1 -- 172.21.15.100:0/2950983537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55fe6fa8b6b0 con 0x55fe6fd958b0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd11fe00640 1 -- 172.21.15.100:0/2950983537 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd138003b80 con 0x55fe6fd958b0 2024-09-10T21:07:20.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd11fe00640 1 -- 172.21.15.100:0/2950983537 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fd12c010b80 con 0x55fe6fd958b0 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 10 client.5250 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 10 client.5250 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 20 client.5250 populate_metadata read hostname 'smithi100' 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] conn(0x55fe6fd939b0 0x55fe6fd93d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 4 client.5250 mds_command: new command op to 5046 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.990+0000 7fd148cae740 1 -- 172.21.15.100:0/2950983537 --> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe6fcc5520 con 0x55fe6fd939b0 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.991+0000 7fd13ea00640 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] conn(0x55fe6fd939b0 0x55fe6fd93d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.991+0000 7fd13ea00640 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] conn(0x55fe6fd939b0 0x55fe6fd93d90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0881dc00ebd932 server_cookie=e0d0f726eae3dd5e in_seq=0 out_seq=0 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.991+0000 7fd11fe00640 10 client.5250 ms_handle_connect on v2:172.21.15.130:6834/772903553 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd11fe00640 1 -- 172.21.15.100:0/2950983537 <== mds.0 v2:172.21.15.130:6834/772903553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe6fcc5520 con 0x55fe6fd939b0 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd11fe00640 10 client.5250 handle_command_reply: tid=0 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 client.5250 shutdown 2024-09-10T21:07:20.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 -- 172.21.15.100:0/2950983537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd958b0 msgr2=0x55fe6fd74cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd958b0 0x55fe6fd74cb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd12c05f810 tx=0x7fd12c061d10 comp rx=0 tx=0).stop 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 -- 172.21.15.100:0/2950983537 shutdown_connections 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] conn(0x55fe6fd939b0 0x55fe6fd93d90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd75580 0x55fe6fd90da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd958b0 0x55fe6fd74cb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd11fe00640 0 client.5250 ms_handle_reset on v2:172.21.15.130:6834/772903553 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 --2- 172.21.15.100:0/2950983537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fda4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 -- 172.21.15.100:0/2950983537 >> 172.21.15.100:0/2950983537 conn(0x55fe6fd50a20 msgr2=0x55fe6fd761b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 -- 172.21.15.100:0/2950983537 shutdown_connections 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 1 -- 172.21.15.100:0/2950983537 wait complete. 2024-09-10T21:07:20.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:19.993+0000 7fd148cae740 20 client.5250 trim_cache size 0 max 16384 2024-09-10T21:07:20.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.012+0000 7fd148cae740 1 Processor -- start 2024-09-10T21:07:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.012+0000 7fd148cae740 1 -- start start 2024-09-10T21:07:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd148cae740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd4f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd148cae740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd148cae740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd958b0 0x55fe6fdb7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd148cae740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd140200470 con 0x55fe6fd50fa0 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd148cae740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd140148320 con 0x55fe6fd75580 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd148cae740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd1401ffe50 con 0x55fe6fd958b0 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd13ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd4f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd13ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd4f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33036/0 (socket says 172.21.15.100:33036) 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd13ea00640 1 -- 172.21.15.100:0/477345211 learned_addr learned my addr 172.21.15.100:0/477345211 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd13ea00640 1 -- 172.21.15.100:0/477345211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd958b0 msgr2=0x55fe6fdb7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd13ea00640 1 --2- 172.21.15.100:0/477345211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd958b0 0x55fe6fdb7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd13ea00640 1 -- 172.21.15.100:0/477345211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd75580 msgr2=0x55fe6fd4f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd13ea00640 1 --2- 172.21.15.100:0/477345211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.013+0000 7fd13ea00640 1 -- 172.21.15.100:0/477345211 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6fd768b0 con 0x55fe6fd50fa0 2024-09-10T21:07:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.014+0000 7fd13ea00640 1 --2- 172.21.15.100:0/477345211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd4f1f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd130035040 tx=0x7fd13003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b92e6aea4a80a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.014+0000 7fd12aa00640 1 -- 172.21.15.100:0/477345211 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13004a4f0 con 0x55fe6fd50fa0 2024-09-10T21:07:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.014+0000 7fd12aa00640 1 -- 172.21.15.100:0/477345211 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd13004a690 con 0x55fe6fd50fa0 2024-09-10T21:07:20.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.014+0000 7fd12aa00640 1 -- 172.21.15.100:0/477345211 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13004aac0 con 0x55fe6fd50fa0 2024-09-10T21:07:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.014+0000 7fd148cae740 1 -- 172.21.15.100:0/477345211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 msgr2=0x55fe6fd4f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.014+0000 7fd148cae740 1 --2- 172.21.15.100:0/477345211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd4f1f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd130035040 tx=0x7fd13003d000 comp rx=0 tx=0).stop 2024-09-10T21:07:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 -- 172.21.15.100:0/477345211 shutdown_connections 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 --2- 172.21.15.100:0/477345211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd958b0 0x55fe6fdb7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 --2- 172.21.15.100:0/477345211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 --2- 172.21.15.100:0/477345211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd50fa0 0x55fe6fd4f1f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 -- 172.21.15.100:0/477345211 >> 172.21.15.100:0/477345211 conn(0x55fe6fd50a20 msgr2=0x55fe6fda4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 -- 172.21.15.100:0/477345211 shutdown_connections 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 -- 172.21.15.100:0/477345211 wait complete. 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 -- start start 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.015+0000 7fd148cae740 1 Processor -- start 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.016+0000 7fd148cae740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fe14750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.016+0000 7fd148cae740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.016+0000 7fd148cae740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd958b0 0x55fe6fd4f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.016+0000 7fd148cae740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fe6fd752e0 con 0x55fe6fd75580 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.016+0000 7fd148cae740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fe6fd7a0a0 con 0x55fe6fd50fa0 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.016+0000 7fd148cae740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55fe6fda82d0 con 0x55fe6fd958b0 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd148cae740 10 client.0 _ll_register_callbacks cb 0x7fd12c061ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33040/0 (socket says 172.21.15.100:33040) 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 -- 172.21.15.100:0/810538953 learned_addr learned my addr 172.21.15.100:0/810538953 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13ea00640 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fe14750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 -- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd958b0 msgr2=0x55fe6fd4f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd958b0 0x55fe6fd4f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 -- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 msgr2=0x55fe6fe14750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fe14750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 -- 172.21.15.100:0/810538953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe6fd8e840 con 0x55fe6fd75580 2024-09-10T21:07:20.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13ea00640 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fe14750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd13e000640 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f1f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd12c062250 tx=0x7fd12c062420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78f106524c12542 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd11fe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.017+0000 7fd11fe00640 1 -- 172.21.15.100:0/810538953 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c020070 con 0x55fe6fd75580 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd11fe00640 1 -- 172.21.15.100:0/810538953 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd12c061a00 con 0x55fe6fd75580 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 1 -- 172.21.15.100:0/810538953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd13004a690 con 0x55fe6fd75580 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd11fe00640 1 -- 172.21.15.100:0/810538953 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd12c05e440 con 0x55fe6fd75580 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 10 client.5256 fetch_fsmap learned FSMap version 18 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 1 -- 172.21.15.100:0/810538953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55fe6fd925b0 con 0x55fe6fd75580 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd11fe00640 1 -- 172.21.15.100:0/810538953 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd13004a690 con 0x55fe6fd75580 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd11fe00640 1 -- 172.21.15.100:0/810538953 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fd12c069280 con 0x55fe6fd75580 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 10 client.5256 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 10 client.5256 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T21:07:20.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 20 client.5256 populate_metadata read hostname 'smithi100' 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] conn(0x55fe6fd76ec0 0x55fe6fd772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 4 client.5256 mds_command: new command op to 5046 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd148cae740 1 -- 172.21.15.100:0/810538953 --> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] -- command(tid 0: {"prefix": "status"}) -- 0x55fe6fcc0fd0 con 0x55fe6fd76ec0 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.018+0000 7fd13ea00640 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] conn(0x55fe6fd76ec0 0x55fe6fd772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.019+0000 7fd13ea00640 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] conn(0x55fe6fd76ec0 0x55fe6fd772a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b32dfcdc53d343a server_cookie=42004df3bbfb6d2f in_seq=0 out_seq=0 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.019+0000 7fd11fe00640 10 client.5256 ms_handle_connect on v2:172.21.15.130:6834/772903553 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.019+0000 7fd11fe00640 1 -- 172.21.15.100:0/810538953 <== mds.0 v2:172.21.15.130:6834/772903553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55fe6fcc0fd0 con 0x55fe6fd76ec0 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.019+0000 7fd11fe00640 10 client.5256 handle_command_reply: tid=0 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.019+0000 7fd148cae740 1 client.5256 shutdown 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.019+0000 7fd148cae740 1 -- 172.21.15.100:0/810538953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd75580 msgr2=0x55fe6fd4f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.019+0000 7fd148cae740 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f1f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd12c062250 tx=0x7fd12c062420 comp rx=0 tx=0).stop 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 1 -- 172.21.15.100:0/810538953 shutdown_connections 2024-09-10T21:07:20.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:6834/772903553,v1:172.21.15.130:6836/772903553] conn(0x55fe6fd76ec0 0x55fe6fd772a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fe6fd958b0 0x55fe6fd4f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe6fd75580 0x55fe6fd4f1f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd11fe00640 0 client.5256 ms_handle_reset on v2:172.21.15.130:6834/772903553 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 1 --2- 172.21.15.100:0/810538953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe6fd50fa0 0x55fe6fe14750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 1 -- 172.21.15.100:0/810538953 >> 172.21.15.100:0/810538953 conn(0x55fe6fd50a20 msgr2=0x55fe6fda4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 1 -- 172.21.15.100:0/810538953 shutdown_connections 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 1 -- 172.21.15.100:0/810538953 wait complete. 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd148cae740 20 client.5256 trim_cache size 0 max 16384 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "65dcb08a-1e46-42c5-ba37-fc802a6ee031", 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-10T21:07:20.030 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5046, 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 11.046208288000001, 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 18, 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 41, 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 41, 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 17.987207535 2024-09-10T21:07:20.031 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 -- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd120077f70 msgr2=0x7fd12007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd120077f70 0x7fd12007a430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd130034000 tx=0x7fd130004730 comp rx=0 tx=0).stop 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 -- 172.21.15.100:0/3484349155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 msgr2=0x7fd1401e52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 0x7fd1401e52b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00d950 tx=0x7fd12c00de10 comp rx=0 tx=0).stop 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 -- 172.21.15.100:0/3484349155 shutdown_connections 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fd120077f70 0x7fd12007a430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd14015c750 0x7fd140145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd14015b680 0x7fd1401e52b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 --2- 172.21.15.100:0/3484349155 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1400741e0 0x7fd140144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.020+0000 7fd145e00640 1 -- 172.21.15.100:0/3484349155 >> 172.21.15.100:0/3484349155 conn(0x7fd14006cb50 msgr2=0x7fd14006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:20.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.021+0000 7fd145e00640 1 -- 172.21.15.100:0/3484349155 shutdown_connections 2024-09-10T21:07:20.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.021+0000 7fd145e00640 1 -- 172.21.15.100:0/3484349155 wait complete. 2024-09-10T21:07:20.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T21:07:20.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.193+0000 7f765b200640 1 -- 172.21.15.100:0/1390292853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7654073c70 msgr2=0x7f765415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.193+0000 7f765b200640 1 --2- 172.21.15.100:0/1390292853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7654073c70 0x7f765415bef0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f76540d0380 tx=0x7f764002a5f0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.193+0000 7f765b200640 1 -- 172.21.15.100:0/1390292853 shutdown_connections 2024-09-10T21:07:20.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.193+0000 7f765b200640 1 --2- 172.21.15.100:0/1390292853 >> v2:172.21.15.130:3300/0 conn(0x7f765415ae80 0x7f765415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.193+0000 7f765b200640 1 --2- 172.21.15.100:0/1390292853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7654073c70 0x7f765415bef0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.193+0000 7f765b200640 1 -- 172.21.15.100:0/1390292853 >> 172.21.15.100:0/1390292853 conn(0x7f765406cb50 msgr2=0x7f765406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:20.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.193+0000 7f765b200640 1 -- 172.21.15.100:0/1390292853 shutdown_connections 2024-09-10T21:07:20.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.193+0000 7f765b200640 1 -- 172.21.15.100:0/1390292853 wait complete. 2024-09-10T21:07:20.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.195+0000 7f765b200640 1 Processor -- start 2024-09-10T21:07:20.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.195+0000 7f765b200640 1 -- start start 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f765b200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7654073c70 0x7f76541f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f765b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7654154cf0 0x7f7654144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f765b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765415ae80 0x7f76540abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f765b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f765406fa30 con 0x7f765415ae80 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f765b200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f765406f8b0 con 0x7f7654154cf0 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f765b200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f765406fbb0 con 0x7f7654073c70 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f7659200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765415ae80 0x7f76540abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f7659200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765415ae80 0x7f76540abb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33050/0 (socket says 172.21.15.100:33050) 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f7659200640 1 -- 172.21.15.100:0/3210884312 learned_addr learned my addr 172.21.15.100:0/3210884312 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:20.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f7653400640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7654154cf0 0x7f7654144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.196+0000 7f7653e00640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7654073c70 0x7f76541f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f7659200640 1 -- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7654073c70 msgr2=0x7f76541f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f7659200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7654073c70 0x7f76541f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f7659200640 1 -- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7654154cf0 msgr2=0x7f7654144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f7659200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7654154cf0 0x7f7654144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f7659200640 1 -- 172.21.15.100:0/3210884312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76541f5c50 con 0x7f765415ae80 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f7659200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765415ae80 0x7f76540abb20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f764c00d660 tx=0x7f764c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f764be00640 1 -- 172.21.15.100:0/3210884312 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c017070 con 0x7f765415ae80 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f764be00640 1 -- 172.21.15.100:0/3210884312 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f764c005310 con 0x7f765415ae80 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f764be00640 1 -- 172.21.15.100:0/3210884312 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c009820 con 0x7f765415ae80 2024-09-10T21:07:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76541f5f30 con 0x7f765415ae80 2024-09-10T21:07:20.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.197+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76541f64f0 con 0x7f765415ae80 2024-09-10T21:07:20.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.198+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765415bef0 con 0x7f765415ae80 2024-09-10T21:07:20.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.199+0000 7f764be00640 1 -- 172.21.15.100:0/3210884312 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f764c0099c0 con 0x7f765415ae80 2024-09-10T21:07:20.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.200+0000 7f764be00640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7634077f70 0x7f763407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:20.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.201+0000 7f764be00640 1 -- 172.21.15.100:0/3210884312 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f764c099e20 con 0x7f765415ae80 2024-09-10T21:07:20.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.201+0000 7f7653e00640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7634077f70 0x7f763407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:20.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.202+0000 7f7653e00640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7634077f70 0x7f763407a430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7644001ec0 tx=0x7f7644009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:20.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.205+0000 7f764be00640 1 -- 172.21.15.100:0/3210884312 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f764c0621d0 con 0x7f765415ae80 2024-09-10T21:07:20.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.424+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f76541571d0 con 0x7f765415ae80 2024-09-10T21:07:20.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.424+0000 7f764be00640 1 -- 172.21.15.100:0/3210884312 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f764c066c00 con 0x7f765415ae80 2024-09-10T21:07:20.429 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T21:07:20.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7634077f70 msgr2=0x7f763407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7634077f70 0x7f763407a430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7644001ec0 tx=0x7f7644009040 comp rx=0 tx=0).stop 2024-09-10T21:07:20.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765415ae80 msgr2=0x7f76540abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:20.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765415ae80 0x7f76540abb20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f764c00d660 tx=0x7f764c00db20 comp rx=0 tx=0).stop 2024-09-10T21:07:20.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 shutdown_connections 2024-09-10T21:07:20.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f765415ae80 0x7f76540abb20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7634077f70 0x7f763407a430 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7654154cf0 0x7f7654144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 --2- 172.21.15.100:0/3210884312 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7654073c70 0x7f76541f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:20.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 >> 172.21.15.100:0/3210884312 conn(0x7f765406cb50 msgr2=0x7f76541553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:20.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 shutdown_connections 2024-09-10T21:07:20.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20.427+0000 7f765b200640 1 -- 172.21.15.100:0/3210884312 wait complete. 2024-09-10T21:07:20.447 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T21:07:20.447 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:07:20.448 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-10T21:07:20.448 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T21:07:20.448 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:20.448 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T21:07:20.448 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:07:20.448 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:07:20.448 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:07:20.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:20.448 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-10T21:07:20.484 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:07:20.484 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:07:20.484 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:07:20.484 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:20.484 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42619sec preferred_lft 42619sec 2024-09-10T21:07:20.485 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2a:56:13:5b:20:3e brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::c876:b2ff:fedc:cb5a/64 scope link 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2a:56:13:5b:20:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::2856:13ff:fe5b:203e/64 scope link 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T21:07:20.486 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 86:18:1c:2f:64:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:20.487 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::8418:1cff:fe2f:641c/64 scope link 2024-09-10T21:07:20.487 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:20.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:20.487 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:07:20.577 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T21:07:20.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:20.580 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-10T21:07:20.616 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-10T21:07:20.616 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:07:20.616 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T21:07:20.616 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T21:07:20.617 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:07:20.617 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:07:20.617 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:07:20.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T21:07:20.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T21:07:20.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T21:07:20.617 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:07:20.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:07:20.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:07:20.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:20.813 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T21:07:20.848 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T21:07:20.849 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T21:07:20.849 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:07:20.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:20.849 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-10T21:07:20.945 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T21:07:20.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:07:20.946 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:20.980 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:07:20.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:07:20.981 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:21.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:07:21.152 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:07:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:07:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:07:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:07:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:21.190 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:21.191 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:21.191 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:21.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:21.191 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:07:21.266 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T21:07:21.266 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T21:07:21.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:07:21.367 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:07:21.404 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:07:21.405 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:21.406 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:21.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:21.407 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:07:21.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-09-10T21:07:21.451+0000 7f81ac871480 -1 init, newargv = 0x55c34f6ad530 newargc=15 2024-09-10T21:07:21.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[49512]: starting ceph client 2024-09-10T21:07:21.464 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[49512]: starting fuse 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi100.stdout:42 2024-09-10T21:07:21.484 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T21:07:21.485 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-10T21:07:21.486 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-10T21:07:21.487 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-10T21:07:21.487 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:07:21.487 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:21.487 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-09-10T21:07:21.487 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-10T21:07:21.645 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.49512.asok 2024-09-10T21:07:21.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:07:21.659 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49512.asok 2024-09-10T21:07:21.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:21.660 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49512.asok status 2024-09-10T21:07:21.840 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "49512", 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5271, 2024-09-10T21:07:21.841 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5271 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3068377876 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:07:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3068377876 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5271 192.168.0.1:0/3068377876", 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/3068377876", 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 18, 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 41, 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-09-10T21:07:21.843 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:21.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:21.853 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-09-10T21:07:21.853 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:21.888 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-09-10T21:07:21.888 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:21.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:21.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:21.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:21.985 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=foo bs=1M count=32) 2024-09-10T21:07:22.290 INFO:teuthology.orchestra.run.smithi100.stderr:32+0 records in 2024-09-10T21:07:22.290 INFO:teuthology.orchestra.run.smithi100.stderr:32+0 records out 2024-09-10T21:07:22.290 INFO:teuthology.orchestra.run.smithi100.stderr:33554432 bytes (34 MB, 32 MiB) copied, 0.26149 s, 128 MB/s 2024-09-10T21:07:22.291 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:07:22.291 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:22.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:07:22.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.523+0000 7fea40800640 1 -- 172.21.15.100:0/3771478707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea20004800 msgr2=0x7fea20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.523+0000 7fea40800640 1 --2- 172.21.15.100:0/3771478707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea20004800 0x7fea20004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fea28001690 tx=0x7fea20005830 comp rx=0 tx=0).stop 2024-09-10T21:07:22.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.523+0000 7fea40800640 1 -- 172.21.15.100:0/3771478707 shutdown_connections 2024-09-10T21:07:22.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.523+0000 7fea40800640 1 --2- 172.21.15.100:0/3771478707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea20004800 0x7fea20004c80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.523+0000 7fea40800640 1 -- 172.21.15.100:0/3771478707 >> 172.21.15.100:0/3771478707 conn(0x7fea3806cb50 msgr2=0x7fea3806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:22.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.523+0000 7fea40800640 1 -- 172.21.15.100:0/3771478707 shutdown_connections 2024-09-10T21:07:22.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.523+0000 7fea40800640 1 -- 172.21.15.100:0/3771478707 wait complete. 2024-09-10T21:07:22.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.525+0000 7fea40800640 1 Processor -- start 2024-09-10T21:07:22.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.525+0000 7fea40800640 1 -- start start 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea40800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea20004800 0x7fea38140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea40800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3814d600 0x7fea38141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea40800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea381f60a0 0x7fea381f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea40800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fea3815f650 con 0x7fea381f60a0 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea40800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea3815f4d0 con 0x7fea20004800 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea40800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fea3815f7d0 con 0x7fea3814d600 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea20004800 0x7fea38140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3814d600 0x7fea38141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:22.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea20004800 0x7fea38140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.100:43716/0 (socket says 172.21.15.100:43716) 2024-09-10T21:07:22.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3de00640 1 -- 172.21.15.100:0/2765156539 learned_addr learned my addr 172.21.15.100:0/2765156539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:22.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3e800640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea381f60a0 0x7fea381f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:22.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3de00640 1 -- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3814d600 msgr2=0x7fea38141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3de00640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3814d600 0x7fea38141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3de00640 1 -- 172.21.15.100:0/2765156539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea381f60a0 msgr2=0x7fea381f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3de00640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea381f60a0 0x7fea381f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.526+0000 7fea3de00640 1 -- 172.21.15.100:0/2765156539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea381527e0 con 0x7fea20004800 2024-09-10T21:07:22.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.527+0000 7fea3de00640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea20004800 0x7fea38140e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea2c011a10 tx=0x7fea2c011ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:22.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.527+0000 7fea32000640 1 -- 172.21.15.100:0/2765156539 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c01e070 con 0x7fea20004800 2024-09-10T21:07:22.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.527+0000 7fea32000640 1 -- 172.21.15.100:0/2765156539 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea2c004460 con 0x7fea20004800 2024-09-10T21:07:22.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.527+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea38151170 con 0x7fea20004800 2024-09-10T21:07:22.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.527+0000 7fea32000640 1 -- 172.21.15.100:0/2765156539 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00fc00 con 0x7fea20004800 2024-09-10T21:07:22.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.527+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea38152a80 con 0x7fea20004800 2024-09-10T21:07:22.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.528+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea380cf7d0 con 0x7fea20004800 2024-09-10T21:07:22.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.530+0000 7fea32000640 1 -- 172.21.15.100:0/2765156539 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fea2c02b080 con 0x7fea20004800 2024-09-10T21:07:22.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.530+0000 7fea32000640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea1c077f70 0x7fea1c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:22.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.531+0000 7fea32000640 1 -- 172.21.15.100:0/2765156539 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fea2c09b090 con 0x7fea20004800 2024-09-10T21:07:22.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.531+0000 7fea3d400640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea1c077f70 0x7fea1c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:22.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.531+0000 7fea3d400640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea1c077f70 0x7fea1c07a430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fea28032000 tx=0x7fea2802c040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:22.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.535+0000 7fea32000640 1 -- 172.21.15.100:0/2765156539 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fea2c063420 con 0x7fea20004800 2024-09-10T21:07:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.730+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea381552d0 con 0x7fea20004800 2024-09-10T21:07:22.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.730+0000 7fea32000640 1 -- 172.21.15.100:0/2765156539 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7fea2c067e50 con 0x7fea20004800 2024-09-10T21:07:22.734 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea1c077f70 msgr2=0x7fea1c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea1c077f70 0x7fea1c07a430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fea28032000 tx=0x7fea2802c040 comp rx=0 tx=0).stop 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea20004800 msgr2=0x7fea38140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea20004800 0x7fea38140e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea2c011a10 tx=0x7fea2c011ed0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 shutdown_connections 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea381f60a0 0x7fea381f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fea3814d600 0x7fea38141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fea1c077f70 0x7fea1c07a430 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 --2- 172.21.15.100:0/2765156539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea20004800 0x7fea38140e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 >> 172.21.15.100:0/2765156539 conn(0x7fea3806cb50 msgr2=0x7fea3806cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 shutdown_connections 2024-09-10T21:07:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.733+0000 7fea40800640 1 -- 172.21.15.100:0/2765156539 wait complete. 2024-09-10T21:07:22.752 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:07:22.752 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:22.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:07:22.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.983+0000 7f2fc2600640 1 -- 172.21.15.100:0/1442850143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa0003aa0 msgr2=0x7f2fa0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.983+0000 7f2fc2600640 1 --2- 172.21.15.100:0/1442850143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa0003aa0 0x7f2fa0003ec0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c610 tx=0x7f2fa0005830 comp rx=0 tx=0).stop 2024-09-10T21:07:22.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.983+0000 7f2fc2600640 1 -- 172.21.15.100:0/1442850143 shutdown_connections 2024-09-10T21:07:22.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.983+0000 7f2fc2600640 1 --2- 172.21.15.100:0/1442850143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa0003aa0 0x7f2fa0003ec0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.983+0000 7f2fc2600640 1 -- 172.21.15.100:0/1442850143 >> 172.21.15.100:0/1442850143 conn(0x7f2fbc06cb50 msgr2=0x7f2fbc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:22.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.983+0000 7f2fc2600640 1 -- 172.21.15.100:0/1442850143 shutdown_connections 2024-09-10T21:07:22.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.983+0000 7f2fc2600640 1 -- 172.21.15.100:0/1442850143 wait complete. 2024-09-10T21:07:22.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.985+0000 7f2fc2600640 1 Processor -- start 2024-09-10T21:07:22.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.985+0000 7f2fc2600640 1 -- start start 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fc2600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa0003aa0 0x7f2fbc1f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fc2600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fbc151ef0 0x7f2fbc0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fc2600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fbc152360 0x7f2fbc0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fc2600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc15c2e0 con 0x7f2fbc152360 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fc2600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc15c160 con 0x7f2fa0003aa0 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fc2600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc15ae80 con 0x7f2fbc151ef0 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fbc152360 0x7f2fbc0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fbc152360 0x7f2fbc0b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46344/0 (socket says 172.21.15.100:46344) 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fbbe00640 1 -- 172.21.15.100:0/1866176660 learned_addr learned my addr 172.21.15.100:0/1866176660 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fbaa00640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fbc151ef0 0x7f2fbc0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.986+0000 7f2fbb400640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa0003aa0 0x7f2fbc1f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fbbe00640 1 -- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fbc151ef0 msgr2=0x7f2fbc0aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fbbe00640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fbc151ef0 0x7f2fbc0aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fbbe00640 1 -- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa0003aa0 msgr2=0x7f2fbc1f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fbbe00640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa0003aa0 0x7f2fbc1f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fbbe00640 1 -- 172.21.15.100:0/1866176660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc1f6010 con 0x7f2fbc152360 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fbb400640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa0003aa0 0x7f2fbc1f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fbbe00640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fbc152360 0x7f2fbc0b10d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40117d0 tx=0x7f2fb4011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fb3400640 1 -- 172.21.15.100:0/1866176660 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004460 con 0x7f2fbc152360 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fb3400640 1 -- 172.21.15.100:0/1866176660 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fb400f8c0 con 0x7f2fbc152360 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc0aabb0 con 0x7f2fbc152360 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fb3400640 1 -- 172.21.15.100:0/1866176660 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400fd10 con 0x7f2fbc152360 2024-09-10T21:07:22.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.987+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc0aae90 con 0x7f2fbc152360 2024-09-10T21:07:22.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.988+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc0b4c80 con 0x7f2fbc152360 2024-09-10T21:07:22.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.990+0000 7f2fb3400640 1 -- 172.21.15.100:0/1866176660 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2fb4018070 con 0x7f2fbc152360 2024-09-10T21:07:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.990+0000 7f2fb3400640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2f9c077fa0 0x7f2f9c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.991+0000 7f2fb3400640 1 -- 172.21.15.100:0/1866176660 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f2fb409a130 con 0x7f2fbc152360 2024-09-10T21:07:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.991+0000 7f2fbb400640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2f9c077fa0 0x7f2f9c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.992+0000 7f2fbb400640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2f9c077fa0 0x7f2f9c07a460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2fac033000 tx=0x7f2fbc06ecc0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:22.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:22.995+0000 7f2fb3400640 1 -- 172.21.15.100:0/1866176660 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2fbc0b4c80 con 0x7f2fbc152360 2024-09-10T21:07:23.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.187+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2fbc073350 con 0x7f2fbc152360 2024-09-10T21:07:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.187+0000 7f2fb3400640 1 -- 172.21.15.100:0/1866176660 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f2fbc073350 con 0x7f2fbc152360 2024-09-10T21:07:23.191 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:07:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2f9c077fa0 msgr2=0x7f2f9c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2f9c077fa0 0x7f2f9c07a460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2fac033000 tx=0x7f2fbc06ecc0 comp rx=0 tx=0).stop 2024-09-10T21:07:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fbc152360 msgr2=0x7f2fbc0b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fbc152360 0x7f2fbc0b10d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40117d0 tx=0x7f2fb4011c90 comp rx=0 tx=0).stop 2024-09-10T21:07:23.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 shutdown_connections 2024-09-10T21:07:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fbc152360 0x7f2fbc0b10d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fbc151ef0 0x7f2fbc0aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2f9c077fa0 0x7f2f9c07a460 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 --2- 172.21.15.100:0/1866176660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa0003aa0 0x7f2fbc1f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.189+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 >> 172.21.15.100:0/1866176660 conn(0x7f2fbc06cb50 msgr2=0x7f2fbc15de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.190+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 shutdown_connections 2024-09-10T21:07:23.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:23.190+0000 7f2fc2600640 1 -- 172.21.15.100:0/1866176660 wait complete. 2024-09-10T21:07:23.209 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-09-10T21:07:23.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:23.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:23.261 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[49512]: fuse finished with error 0 and tester_r 0 2024-09-10T21:07:23.272 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:07:29.374 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:07:29.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:29.375 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T21:07:29.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T21:07:29.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.614+0000 7ff09f400640 1 -- 172.21.15.100:0/936896840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980741e0 msgr2=0x7ff09815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:29.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.614+0000 7ff09f400640 1 --2- 172.21.15.100:0/936896840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980741e0 0x7ff09815f4d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff084005fd0 tx=0x7ff08402a5d0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.614+0000 7ff09f400640 1 -- 172.21.15.100:0/936896840 shutdown_connections 2024-09-10T21:07:29.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.614+0000 7ff09f400640 1 --2- 172.21.15.100:0/936896840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980741e0 0x7ff09815f4d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.614+0000 7ff09f400640 1 --2- 172.21.15.100:0/936896840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff09815b680 0x7ff09815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.614+0000 7ff09f400640 1 -- 172.21.15.100:0/936896840 >> 172.21.15.100:0/936896840 conn(0x7ff09806cb50 msgr2=0x7ff09806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:29.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.614+0000 7ff09f400640 1 -- 172.21.15.100:0/936896840 shutdown_connections 2024-09-10T21:07:29.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.614+0000 7ff09f400640 1 -- 172.21.15.100:0/936896840 wait complete. 2024-09-10T21:07:29.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.615+0000 7ff09f400640 1 Processor -- start 2024-09-10T21:07:29.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.616+0000 7ff09f400640 1 -- start start 2024-09-10T21:07:29.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.616+0000 7ff09f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0980741e0 0x7ff0980b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:29.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.616+0000 7ff09f400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff09815b680 0x7ff0981529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:29.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.616+0000 7ff09f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815c750 0x7ff0981f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.616+0000 7ff09f400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0980b29e0 con 0x7ff09815c750 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.616+0000 7ff09f400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff0980b2860 con 0x7ff0980741e0 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.616+0000 7ff09f400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff0980b2b60 con 0x7ff09815b680 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815c750 0x7ff0981f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815c750 0x7ff0981f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46356/0 (socket says 172.21.15.100:46356) 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 -- 172.21.15.100:0/2449200488 learned_addr learned my addr 172.21.15.100:0/2449200488 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09ca00640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0980741e0 0x7ff0980b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff097e00640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff09815b680 0x7ff0981529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 -- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff09815b680 msgr2=0x7ff0981529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff09815b680 0x7ff0981529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 -- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0980741e0 msgr2=0x7ff0980b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0980741e0 0x7ff0980b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 -- 172.21.15.100:0/2449200488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0981f2040 con 0x7ff09815c750 2024-09-10T21:07:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09ca00640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0980741e0 0x7ff0980b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.617+0000 7ff09d400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815c750 0x7ff0981f5c60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff09000c6b0 tx=0x7ff09000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.618+0000 7ff094c00640 1 -- 172.21.15.100:0/2449200488 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090003b70 con 0x7ff09815c750 2024-09-10T21:07:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.618+0000 7ff094c00640 1 -- 172.21.15.100:0/2449200488 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff090003d30 con 0x7ff09815c750 2024-09-10T21:07:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.618+0000 7ff094c00640 1 -- 172.21.15.100:0/2449200488 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090005330 con 0x7ff09815c750 2024-09-10T21:07:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.618+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0981f2360 con 0x7ff09815c750 2024-09-10T21:07:29.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.618+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0981f2ba0 con 0x7ff09815c750 2024-09-10T21:07:29.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.619+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0980b3010 con 0x7ff09815c750 2024-09-10T21:07:29.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.620+0000 7ff094c00640 1 -- 172.21.15.100:0/2449200488 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff0900054d0 con 0x7ff09815c750 2024-09-10T21:07:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.621+0000 7ff094c00640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff078077f70 0x7ff07807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.622+0000 7ff094c00640 1 -- 172.21.15.100:0/2449200488 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7ff090099d10 con 0x7ff09815c750 2024-09-10T21:07:29.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.622+0000 7ff09ca00640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff078077f70 0x7ff07807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:29.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.623+0000 7ff09ca00640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff078077f70 0x7ff07807a430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff08c005fd0 tx=0x7ff08c00e660 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:29.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.626+0000 7ff094c00640 1 -- 172.21.15.100:0/2449200488 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff09009f020 con 0x7ff09815c750 2024-09-10T21:07:29.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.842+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff0980cc490 con 0x7ff09815c750 2024-09-10T21:07:29.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.843+0000 7ff094c00640 1 -- 172.21.15.100:0/2449200488 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7ff0981f2360 con 0x7ff09815c750 2024-09-10T21:07:29.847 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T21:07:29.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff078077f70 msgr2=0x7ff07807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:29.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff078077f70 0x7ff07807a430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff08c005fd0 tx=0x7ff08c00e660 comp rx=0 tx=0).stop 2024-09-10T21:07:29.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815c750 msgr2=0x7ff0981f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:29.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815c750 0x7ff0981f5c60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff09000c6b0 tx=0x7ff09000cb70 comp rx=0 tx=0).stop 2024-09-10T21:07:29.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 shutdown_connections 2024-09-10T21:07:29.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815c750 0x7ff0981f5c60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff09815b680 0x7ff0981529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff078077f70 0x7ff07807a430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 --2- 172.21.15.100:0/2449200488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0980741e0 0x7ff0980b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 >> 172.21.15.100:0/2449200488 conn(0x7ff09806cb50 msgr2=0x7ff0980b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:29.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 shutdown_connections 2024-09-10T21:07:29.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:29.845+0000 7ff09f400640 1 -- 172.21.15.100:0/2449200488 wait complete. 2024-09-10T21:07:29.864 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T21:07:29.865 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:07:29.865 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-10T21:07:29.865 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T21:07:29.865 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:29.865 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T21:07:29.865 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:07:29.865 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:07:29.865 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:07:29.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:29.865 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-10T21:07:29.902 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:07:29.902 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:07:29.902 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:07:29.902 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:29.902 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T21:07:29.902 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42610sec preferred_lft 42610sec 2024-09-10T21:07:29.903 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2a:56:13:5b:20:3e brd ff:ff:ff:ff:ff:ff 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::c876:b2ff:fedc:cb5a/64 scope link 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2a:56:13:5b:20:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::2856:13ff:fe5b:203e/64 scope link 2024-09-10T21:07:29.904 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:29.905 INFO:teuthology.orchestra.run.smithi100.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T21:07:29.905 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 86:18:1c:2f:64:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:29.905 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::8418:1cff:fe2f:641c/64 scope link 2024-09-10T21:07:29.905 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:07:29.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:29.905 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:07:29.996 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T21:07:29.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:29.999 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-10T21:07:30.035 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-10T21:07:30.035 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:07:30.035 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T21:07:30.035 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T21:07:30.036 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:07:30.036 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:07:30.036 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T21:07:30.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T21:07:30.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T21:07:30.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T21:07:30.036 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T21:07:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:07:30.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:07:30.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:30.231 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T21:07:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T21:07:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T21:07:30.266 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:07:30.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:30.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-10T21:07:30.362 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T21:07:30.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:07:30.362 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:30.398 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:07:30.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:07:30.398 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:30.473 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:07:30.570 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:07:30.609 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:07:30.610 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:07:30.611 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:30.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:30.613 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:07:30.684 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T21:07:30.684 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T21:07:30.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-10T21:07:30.785 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T21:07:30.825 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-10T21:07:30.825 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-10T21:07:30.825 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-10T21:07:30.825 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-10T21:07:30.825 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-10T21:07:30.825 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-10T21:07:30.825 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-10T21:07:30.825 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T21:07:30.826 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:30.827 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:30.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:30.828 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-10T21:07:30.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-09-10T21:07:30.873+0000 7f515202c480 -1 init, newargv = 0x55860df2b070 newargc=15 2024-09-10T21:07:30.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[50097]: starting ceph client 2024-09-10T21:07:30.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[50097]: starting fuse 2024-09-10T21:07:30.907 INFO:teuthology.orchestra.run.smithi100.stdout:42 2024-09-10T21:07:30.908 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-10T21:07:30.908 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-10T21:07:30.909 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:07:30.910 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:30.910 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-09-10T21:07:30.910 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-10T21:07:31.070 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.50097.asok 2024-09-10T21:07:31.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:07:31.084 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50097.asok 2024-09-10T21:07:31.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:31.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50097.asok status 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "50097", 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:31.266 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5295, 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5295 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4251389039 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-10T21:07:31.267 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4251389039 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.5295 192.168.0.1:0/4251389039", 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/4251389039", 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 18, 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 41, 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-09-10T21:07:31.268 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:31.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:31.278 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-09-10T21:07:31.278 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:31.313 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-09-10T21:07:31.313 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:31.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:31.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:31.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-10T21:07:31.409 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-09-10T21:07:31.410 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-10T21:07:31.531 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.50097.asok 2024-09-10T21:07:31.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:07:31.546 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50097.asok 2024-09-10T21:07:31.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:31.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50097.asok perf dump objecter 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 0, 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 0, 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 0, 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T21:07:31.728 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 0, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T21:07:31.729 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T21:07:31.730 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T21:07:31.731 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T21:07:31.732 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 1, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T21:07:31.733 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T21:07:31.734 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:31.734 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:31.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:31.740 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=foo of=/dev/null bs=128k count=32) 2024-09-10T21:07:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:32+0 records in 2024-09-10T21:07:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:32+0 records out 2024-09-10T21:07:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0228651 s, 183 MB/s 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-10T21:07:31.802 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-09-10T21:07:31.803 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-10T21:07:31.926 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.50097.asok 2024-09-10T21:07:31.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:07:31.940 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50097.asok 2024-09-10T21:07:31.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:31.940 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50097.asok perf dump objecter 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 10, 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 0, 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 10, 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T21:07:32.122 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.036999052, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003699905 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 10 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 10, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 8, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 2, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T21:07:32.123 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 1, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 1, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 8, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T21:07:32.124 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T21:07:32.125 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 1, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T21:07:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 0, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 0, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 2, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 2, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T21:07:32.127 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:32.133 INFO:tasks.cephfs.test_readahead:read operations: 8 2024-09-10T21:07:32.134 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T21:07:32.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T21:07:32.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:07:32.214 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:07:32.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T21:07:32.321 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T21:07:32.322 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T21:07:32.322 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:07:32.322 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:32.357 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:07:32.357 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:32.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T21:07:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.631+0000 7fa2bde00640 1 -- 172.21.15.100:0/1951188102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80b1370 msgr2=0x7fa2b80b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.631+0000 7fa2bde00640 1 --2- 172.21.15.100:0/1951188102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80b1370 0x7fa2b80b17c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80c54e0 tx=0x7fa2a402a560 comp rx=0 tx=0).stop 2024-09-10T21:07:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.631+0000 7fa2bde00640 1 -- 172.21.15.100:0/1951188102 shutdown_connections 2024-09-10T21:07:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.631+0000 7fa2bde00640 1 --2- 172.21.15.100:0/1951188102 >> v2:172.21.15.130:3300/0 conn(0x7fa2b80b1d00 0x7fa2b80af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.631+0000 7fa2bde00640 1 --2- 172.21.15.100:0/1951188102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80b1370 0x7fa2b80b17c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.631+0000 7fa2bde00640 1 -- 172.21.15.100:0/1951188102 >> 172.21.15.100:0/1951188102 conn(0x7fa2b80d1a10 msgr2=0x7fa2b80d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.631+0000 7fa2bde00640 1 -- 172.21.15.100:0/1951188102 shutdown_connections 2024-09-10T21:07:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.631+0000 7fa2bde00640 1 -- 172.21.15.100:0/1951188102 wait complete. 2024-09-10T21:07:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.632+0000 7fa2bde00640 1 Processor -- start 2024-09-10T21:07:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.633+0000 7fa2bde00640 1 -- start start 2024-09-10T21:07:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.633+0000 7fa2bde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b80b1370 0x7fa2b8155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:32.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.633+0000 7fa2bde00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b80b1d00 0x7fa2b8157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.633+0000 7fa2bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80cfbf0 0x7fa2b814bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.633+0000 7fa2bde00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b80b2ac0 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.633+0000 7fa2bde00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b80b2940 con 0x7fa2b80b1370 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.633+0000 7fa2bde00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b80afaa0 con 0x7fa2b80b1d00 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80cfbf0 0x7fa2b814bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80cfbf0 0x7fa2b814bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59728/0 (socket says 172.21.15.100:59728) 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b7400640 1 -- 172.21.15.100:0/4120531796 learned_addr learned my addr 172.21.15.100:0/4120531796 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b6a00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b80b1370 0x7fa2b8155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b6000640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b80b1d00 0x7fa2b8157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b7400640 1 -- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b80b1d00 msgr2=0x7fa2b8157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b7400640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b80b1d00 0x7fa2b8157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b7400640 1 -- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b80b1370 msgr2=0x7fa2b8155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:32.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b7400640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b80b1370 0x7fa2b8155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.634+0000 7fa2b7400640 1 -- 172.21.15.100:0/4120531796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b81582c0 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.635+0000 7fa2b7400640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80cfbf0 0x7fa2b814bd70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000b450 tx=0x7fa2b000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.635+0000 7fa2af400640 1 -- 172.21.15.100:0/4120531796 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0015020 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.635+0000 7fa2af400640 1 -- 172.21.15.100:0/4120531796 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2b0011920 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.635+0000 7fa2af400640 1 -- 172.21.15.100:0/4120531796 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0011d50 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.635+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b81585a0 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.635+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b8158b60 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.636+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b80d0500 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.637+0000 7fa2af400640 1 -- 172.21.15.100:0/4120531796 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa2b001a400 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.638+0000 7fa2af400640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa298077f70 0x7fa29807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:32.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.639+0000 7fa2af400640 1 -- 172.21.15.100:0/4120531796 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fa2b009a000 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.639+0000 7fa2b6a00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa298077f70 0x7fa29807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:32.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.640+0000 7fa2b6a00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa298077f70 0x7fa29807a430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80012e0 tx=0x7fa2a8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:32.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.643+0000 7fa2af400640 1 -- 172.21.15.100:0/4120531796 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa2b80d0500 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.848+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2b80cf6c0 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.848+0000 7fa2af400640 1 -- 172.21.15.100:0/4120531796 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7fa2b001f020 con 0x7fa2b80cfbf0 2024-09-10T21:07:32.852 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa298077f70 msgr2=0x7fa29807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa298077f70 0x7fa29807a430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80012e0 tx=0x7fa2a8009040 comp rx=0 tx=0).stop 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80cfbf0 msgr2=0x7fa2b814bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80cfbf0 0x7fa2b814bd70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000b450 tx=0x7fa2b000b910 comp rx=0 tx=0).stop 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 shutdown_connections 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2b80cfbf0 0x7fa2b814bd70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2b80b1d00 0x7fa2b8157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa298077f70 0x7fa29807a430 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 --2- 172.21.15.100:0/4120531796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2b80b1370 0x7fa2b8155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 >> 172.21.15.100:0/4120531796 conn(0x7fa2b80d1a10 msgr2=0x7fa2b80c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 shutdown_connections 2024-09-10T21:07:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:32.851+0000 7fa2bde00640 1 -- 172.21.15.100:0/4120531796 wait complete. 2024-09-10T21:07:32.871 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-09-10T21:07:32.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:32.872 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T21:07:32.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[50097]: fuse finished with error 0 and tester_r 0 2024-09-10T21:07:32.929 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:07:32.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:32.929 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T21:07:33.064 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T21:07:33.064 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:07:33.064 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:33.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T21:07:33.104 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T21:07:33.104 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:07:33.104 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:33.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T21:07:33.139 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T21:07:33.139 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:07:33.139 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:33.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T21:07:33.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:07:33.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 -- 172.21.15.100:0/2745999745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4806e0a0 msgr2=0x7f3c480d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 --2- 172.21.15.100:0/2745999745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4806e0a0 0x7f3c480d2090 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3c4808c2e0 tx=0x7f3c3002a4d0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 -- 172.21.15.100:0/2745999745 shutdown_connections 2024-09-10T21:07:33.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 --2- 172.21.15.100:0/2745999745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c480d25d0 0x7f3c4806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 --2- 172.21.15.100:0/2745999745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4806e0a0 0x7f3c480d2090 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 --2- 172.21.15.100:0/2745999745 >> v2:172.21.15.130:3300/0 conn(0x7f3c48161140 0x7f3c480b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 -- 172.21.15.100:0/2745999745 >> 172.21.15.100:0/2745999745 conn(0x7f3c480d3ab0 msgr2=0x7f3c480d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:33.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 -- 172.21.15.100:0/2745999745 shutdown_connections 2024-09-10T21:07:33.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.337+0000 7f3c47e00640 1 -- 172.21.15.100:0/2745999745 wait complete. 2024-09-10T21:07:33.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.339+0000 7f3c47e00640 1 Processor -- start 2024-09-10T21:07:33.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.339+0000 7f3c47e00640 1 -- start start 2024-09-10T21:07:33.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c4806e0a0 0x7f3c4815b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48161140 0x7f3c4815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c480b5730 0x7f3c4815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c47e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4806e770 con 0x7f3c48161140 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c47e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48161730 con 0x7f3c480b5730 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c47e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4806e8f0 con 0x7f3c4806e0a0 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c3fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48161140 0x7f3c4815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c3fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48161140 0x7f3c4815de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59754/0 (socket says 172.21.15.100:59754) 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c3fe00640 1 -- 172.21.15.100:0/749043331 learned_addr learned my addr 172.21.15.100:0/749043331 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c47400640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c480b5730 0x7f3c4815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.340+0000 7f3c46a00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c4806e0a0 0x7f3c4815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3fe00640 1 -- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c4806e0a0 msgr2=0x7f3c4815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3fe00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c4806e0a0 0x7f3c4815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3fe00640 1 -- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c480b5730 msgr2=0x7f3c4815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3fe00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c480b5730 0x7f3c4815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3fe00640 1 -- 172.21.15.100:0/749043331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c481f45c0 con 0x7f3c48161140 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c46a00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c4806e0a0 0x7f3c4815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3fe00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48161140 0x7f3c4815de20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009850 tx=0x7f3c30003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3ea00640 1 -- 172.21.15.100:0/749043331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3003f070 con 0x7f3c48161140 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3ea00640 1 -- 172.21.15.100:0/749043331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c300047a0 con 0x7f3c48161140 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c3ea00640 1 -- 172.21.15.100:0/749043331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30035030 con 0x7f3c48161140 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c481f48a0 con 0x7f3c48161140 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.341+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c481f4e60 con 0x7f3c48161140 2024-09-10T21:07:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.342+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c480b93e0 con 0x7f3c48161140 2024-09-10T21:07:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.344+0000 7f3c3ea00640 1 -- 172.21.15.100:0/749043331 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3c30004bb0 con 0x7f3c48161140 2024-09-10T21:07:33.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.345+0000 7f3c3ea00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3c24077f70 0x7f3c2407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.345+0000 7f3c3ea00640 1 -- 172.21.15.100:0/749043331 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f3c300bb0c0 con 0x7f3c48161140 2024-09-10T21:07:33.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.345+0000 7f3c46a00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3c24077f70 0x7f3c2407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.346+0000 7f3c46a00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3c24077f70 0x7f3c2407a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c38005fd0 tx=0x7f3c3800f360 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.349+0000 7f3c3ea00640 1 -- 172.21.15.100:0/749043331 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3c30083340 con 0x7f3c48161140 2024-09-10T21:07:33.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.569+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c480b9100 con 0x7f3c48161140 2024-09-10T21:07:33.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.570+0000 7f3c3ea00640 1 -- 172.21.15.100:0/749043331 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f3c30087d70 con 0x7f3c48161140 2024-09-10T21:07:33.573 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:33.574 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"btime":"2024-09-10T21:07:11:987578+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3760826970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3760826970},{"type":"v1","addr":"172.21.15.100:6834","nonce":3760826970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2104919496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2104919496},{"type":"v1","addr":"172.21.15.130:6837","nonce":2104919496}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2076530872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2076530872},{"type":"v1","addr":"172.21.15.100:6835","nonce":2076530872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:07:08.380674+0000","modified":"2024-09-10T21:07:11.401889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/772903553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":772903553},{"type":"v1","addr":"172.21.15.130:6836","nonce":772903553}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-09-10T21:07:33.574 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3c24077f70 msgr2=0x7f3c2407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3c24077f70 0x7f3c2407a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c38005fd0 tx=0x7f3c3800f360 comp rx=0 tx=0).stop 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48161140 msgr2=0x7f3c4815de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48161140 0x7f3c4815de20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009850 tx=0x7f3c30003910 comp rx=0 tx=0).stop 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 shutdown_connections 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3c24077f70 0x7f3c2407a430 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c480b5730 0x7f3c4815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48161140 0x7f3c4815de20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 --2- 172.21.15.100:0/749043331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c4806e0a0 0x7f3c4815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 >> 172.21.15.100:0/749043331 conn(0x7f3c480d3ab0 msgr2=0x7f3c480b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:33.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 shutdown_connections 2024-09-10T21:07:33.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.572+0000 7f3c47e00640 1 -- 172.21.15.100:0/749043331 wait complete. 2024-09-10T21:07:33.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:07:33.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.748+0000 7fc4a5c00640 1 -- 172.21.15.100:0/1453247102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a00caeb0 msgr2=0x7fc4a006e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.748+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/1453247102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a00caeb0 0x7fc4a006e250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc4a006fa20 tx=0x7fc48802a5f0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.748+0000 7fc4a5c00640 1 -- 172.21.15.100:0/1453247102 shutdown_connections 2024-09-10T21:07:33.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.748+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/1453247102 >> v2:172.21.15.130:3300/0 conn(0x7fc4a006e790 0x7fc4a00cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.748+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/1453247102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a00caeb0 0x7fc4a006e250 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.748+0000 7fc4a5c00640 1 -- 172.21.15.100:0/1453247102 >> 172.21.15.100:0/1453247102 conn(0x7fc4a006d500 msgr2=0x7fc4a00b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:33.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.748+0000 7fc4a5c00640 1 -- 172.21.15.100:0/1453247102 shutdown_connections 2024-09-10T21:07:33.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.748+0000 7fc4a5c00640 1 -- 172.21.15.100:0/1453247102 wait complete. 2024-09-10T21:07:33.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.750+0000 7fc4a5c00640 1 Processor -- start 2024-09-10T21:07:33.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.750+0000 7fc4a5c00640 1 -- start start 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc4a5c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a006e790 0x7fc4a015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc4a5c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4a00caeb0 0x7fc4a01514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc4a5c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4a0150e10 0x7fc4a00b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc4a5c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a015b340 con 0x7fc4a006e790 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc4a5c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a015b1c0 con 0x7fc4a0150e10 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc4a5c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a00cc1a0 con 0x7fc4a00caeb0 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc49fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a006e790 0x7fc4a015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc49fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a006e790 0x7fc4a015b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59776/0 (socket says 172.21.15.100:59776) 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc49fe00640 1 -- 172.21.15.100:0/3106272965 learned_addr learned my addr 172.21.15.100:0/3106272965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:33.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc49fe00640 1 -- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4a00caeb0 msgr2=0x7fc4a01514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc49fe00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4a00caeb0 0x7fc4a01514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc49fe00640 1 -- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4a0150e10 msgr2=0x7fc4a00b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc49fe00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4a0150e10 0x7fc4a00b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.751+0000 7fc49fe00640 1 -- 172.21.15.100:0/3106272965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a01f42d0 con 0x7fc4a006e790 2024-09-10T21:07:33.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.752+0000 7fc49fe00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a006e790 0x7fc4a015b760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c3a0 tx=0x7fc49000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:33.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.752+0000 7fc49cc00640 1 -- 172.21.15.100:0/3106272965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490017070 con 0x7fc4a006e790 2024-09-10T21:07:33.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.752+0000 7fc49cc00640 1 -- 172.21.15.100:0/3106272965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4900053c0 con 0x7fc4a006e790 2024-09-10T21:07:33.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.752+0000 7fc49cc00640 1 -- 172.21.15.100:0/3106272965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490003850 con 0x7fc4a006e790 2024-09-10T21:07:33.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.752+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a015bf60 con 0x7fc4a006e790 2024-09-10T21:07:33.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.752+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a015c520 con 0x7fc4a006e790 2024-09-10T21:07:33.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.753+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a01f44a0 con 0x7fc4a006e790 2024-09-10T21:07:33.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.754+0000 7fc49cc00640 1 -- 172.21.15.100:0/3106272965 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc4900039f0 con 0x7fc4a006e790 2024-09-10T21:07:33.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.755+0000 7fc49cc00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc47c077f70 0x7fc47c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.755+0000 7fc49cc00640 1 -- 172.21.15.100:0/3106272965 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fc490099450 con 0x7fc4a006e790 2024-09-10T21:07:33.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.756+0000 7fc497e00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc47c077f70 0x7fc47c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.756+0000 7fc497e00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc47c077f70 0x7fc47c07a430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc488033000 tx=0x7fc4880046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:33.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.759+0000 7fc49cc00640 1 -- 172.21.15.100:0/3106272965 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc490061e50 con 0x7fc4a006e790 2024-09-10T21:07:33.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.979+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4a00cc560 con 0x7fc4a006e790 2024-09-10T21:07:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.979+0000 7fc49cc00640 1 -- 172.21.15.100:0/3106272965 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7fc490061750 con 0x7fc4a006e790 2024-09-10T21:07:33.983 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:33.983 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"btime":"2024-09-10T21:07:11:987578+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3760826970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3760826970},{"type":"v1","addr":"172.21.15.100:6834","nonce":3760826970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2104919496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2104919496},{"type":"v1","addr":"172.21.15.130:6837","nonce":2104919496}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2076530872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2076530872},{"type":"v1","addr":"172.21.15.100:6835","nonce":2076530872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:07:08.380674+0000","modified":"2024-09-10T21:07:11.401889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/772903553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":772903553},{"type":"v1","addr":"172.21.15.130:6836","nonce":772903553}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-09-10T21:07:33.983 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-10T21:07:33.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc47c077f70 msgr2=0x7fc47c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc47c077f70 0x7fc47c07a430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc488033000 tx=0x7fc4880046c0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a006e790 msgr2=0x7fc4a015b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a006e790 0x7fc4a015b760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c3a0 tx=0x7fc49000c860 comp rx=0 tx=0).stop 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 shutdown_connections 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc47c077f70 0x7fc47c07a430 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4a0150e10 0x7fc4a00b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4a00caeb0 0x7fc4a01514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.981+0000 7fc4a5c00640 1 --2- 172.21.15.100:0/3106272965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a006e790 0x7fc4a015b760 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.982+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 >> 172.21.15.100:0/3106272965 conn(0x7fc4a006d500 msgr2=0x7fc4a00720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.982+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 shutdown_connections 2024-09-10T21:07:33.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:33.982+0000 7fc4a5c00640 1 -- 172.21.15.100:0/3106272965 wait complete. 2024-09-10T21:07:34.000 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:07:34.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.153+0000 7fb5a5600640 1 -- 172.21.15.100:0/4005114169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a015c750 msgr2=0x7fb5a00cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.153+0000 7fb5a5600640 1 --2- 172.21.15.100:0/4005114169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a015c750 0x7fb5a00cf780 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb598005fd0 tx=0x7fb59802ab30 comp rx=0 tx=0).stop 2024-09-10T21:07:34.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.153+0000 7fb5a5600640 1 -- 172.21.15.100:0/4005114169 shutdown_connections 2024-09-10T21:07:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.153+0000 7fb5a5600640 1 --2- 172.21.15.100:0/4005114169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a015c750 0x7fb5a00cf780 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.153+0000 7fb5a5600640 1 -- 172.21.15.100:0/4005114169 >> 172.21.15.100:0/4005114169 conn(0x7fb5a006cb50 msgr2=0x7fb5a006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.153+0000 7fb5a5600640 1 -- 172.21.15.100:0/4005114169 shutdown_connections 2024-09-10T21:07:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.154+0000 7fb5a5600640 1 -- 172.21.15.100:0/4005114169 wait complete. 2024-09-10T21:07:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.155+0000 7fb5a5600640 1 Processor -- start 2024-09-10T21:07:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.155+0000 7fb5a5600640 1 -- start start 2024-09-10T21:07:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb5a5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a00741e0 0x7fb5a00ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb5a5600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a015b680 0x7fb5a00aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb5a5600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a015c750 0x7fb5a015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb5a5600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a00b2bf0 con 0x7fb5a00741e0 2024-09-10T21:07:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb5a5600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a00b2a70 con 0x7fb5a015b680 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb5a5600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a00b2d70 con 0x7fb5a015c750 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb59ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a00741e0 0x7fb5a00ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb59ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a00741e0 0x7fb5a00ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59792/0 (socket says 172.21.15.100:59792) 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.156+0000 7fb59ea00640 1 -- 172.21.15.100:0/2159193028 learned_addr learned my addr 172.21.15.100:0/2159193028 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb59f400640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a015c750 0x7fb5a015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb59e000640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a015b680 0x7fb5a00aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb59ea00640 1 -- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a015c750 msgr2=0x7fb5a015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb59ea00640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a015c750 0x7fb5a015a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb59ea00640 1 -- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a015b680 msgr2=0x7fb5a00aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb59ea00640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a015b680 0x7fb5a00aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb59ea00640 1 -- 172.21.15.100:0/2159193028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a00ade30 con 0x7fb5a00741e0 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb59ea00640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a00741e0 0x7fb5a00ad850 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c500 tx=0x7fb59000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:34.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb596a00640 1 -- 172.21.15.100:0/2159193028 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900052d0 con 0x7fb5a00741e0 2024-09-10T21:07:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb596a00640 1 -- 172.21.15.100:0/2159193028 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb590005470 con 0x7fb5a00741e0 2024-09-10T21:07:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb596a00640 1 -- 172.21.15.100:0/2159193028 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590012870 con 0x7fb5a00741e0 2024-09-10T21:07:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.157+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a00ae110 con 0x7fb5a00741e0 2024-09-10T21:07:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.158+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a00ae6d0 con 0x7fb5a00741e0 2024-09-10T21:07:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.159+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a00cc490 con 0x7fb5a00741e0 2024-09-10T21:07:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.160+0000 7fb596a00640 1 -- 172.21.15.100:0/2159193028 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb5900035f0 con 0x7fb5a00741e0 2024-09-10T21:07:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.161+0000 7fb596a00640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb580077f70 0x7fb58007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.161+0000 7fb596a00640 1 -- 172.21.15.100:0/2159193028 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fb590099bb0 con 0x7fb5a00741e0 2024-09-10T21:07:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.161+0000 7fb59e000640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb580077f70 0x7fb58007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.162+0000 7fb59e000640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb580077f70 0x7fb58007a430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0070090 tx=0x7fb58c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.165+0000 7fb596a00640 1 -- 172.21.15.100:0/2159193028 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb590062490 con 0x7fb5a00741e0 2024-09-10T21:07:34.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.351+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5a00ce330 con 0x7fb5a00741e0 2024-09-10T21:07:34.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.352+0000 7fb596a00640 1 -- 172.21.15.100:0/2159193028 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17026 (secure 0 0 0) 0x7fb590061d90 con 0x7fb5a00741e0 2024-09-10T21:07:34.356 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:34.356 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:07:09.973363+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:07:06.699580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T21:07:07.345691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:07:34.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.354+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb580077f70 msgr2=0x7fb58007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.354+0000 7fb5a5600640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb580077f70 0x7fb58007a430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0070090 tx=0x7fb58c009040 comp rx=0 tx=0).stop 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.354+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a00741e0 msgr2=0x7fb5a00ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.354+0000 7fb5a5600640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a00741e0 0x7fb5a00ad850 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c500 tx=0x7fb59000c9c0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.355+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 shutdown_connections 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.355+0000 7fb5a5600640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5a015c750 0x7fb5a015a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.355+0000 7fb5a5600640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb580077f70 0x7fb58007a430 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.355+0000 7fb5a5600640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a015b680 0x7fb5a00aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.355+0000 7fb5a5600640 1 --2- 172.21.15.100:0/2159193028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5a00741e0 0x7fb5a00ad850 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.355+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 >> 172.21.15.100:0/2159193028 conn(0x7fb5a006cb50 msgr2=0x7fb5a00b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.355+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 shutdown_connections 2024-09-10T21:07:34.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.355+0000 7fb5a5600640 1 -- 172.21.15.100:0/2159193028 wait complete. 2024-09-10T21:07:34.374 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T21:07:34.375 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:07:34.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.527+0000 7f363aa00640 1 -- 172.21.15.100:0/514437647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36340aea30 msgr2=0x7f3634073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.527+0000 7f363aa00640 1 --2- 172.21.15.100:0/514437647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36340aea30 0x7f3634073610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3628005fd0 tx=0x7f362802aa90 comp rx=0 tx=0).stop 2024-09-10T21:07:34.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.527+0000 7f363aa00640 1 -- 172.21.15.100:0/514437647 shutdown_connections 2024-09-10T21:07:34.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.527+0000 7f363aa00640 1 --2- 172.21.15.100:0/514437647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f363415f8f0 0x7f363415fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.527+0000 7f363aa00640 1 --2- 172.21.15.100:0/514437647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36340aea30 0x7f3634073610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.527+0000 7f363aa00640 1 -- 172.21.15.100:0/514437647 >> 172.21.15.100:0/514437647 conn(0x7f363406d500 msgr2=0x7f36340b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:34.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.527+0000 7f363aa00640 1 -- 172.21.15.100:0/514437647 shutdown_connections 2024-09-10T21:07:34.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.528+0000 7f363aa00640 1 -- 172.21.15.100:0/514437647 wait complete. 2024-09-10T21:07:34.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.529+0000 7f363aa00640 1 Processor -- start 2024-09-10T21:07:34.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.529+0000 7f363aa00640 1 -- start start 2024-09-10T21:07:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.530+0000 7f363aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36340aea30 0x7f36341f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.530+0000 7f363aa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36340cec80 0x7f36340c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.530+0000 7f363aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f363415f8f0 0x7f36341e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.530+0000 7f363aa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36340cc110 con 0x7f36340aea30 2024-09-10T21:07:34.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.530+0000 7f363aa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f36340af020 con 0x7f363415f8f0 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.530+0000 7f363aa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f36340cc290 con 0x7f36340cec80 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.530+0000 7f3639600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36340aea30 0x7f36341f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3639600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36340aea30 0x7f36341f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59800/0 (socket says 172.21.15.100:59800) 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3639600640 1 -- 172.21.15.100:0/1597456831 learned_addr learned my addr 172.21.15.100:0/1597456831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3638c00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36340cec80 0x7f36340c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f363a000640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f363415f8f0 0x7f36341e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3639600640 1 -- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36340cec80 msgr2=0x7f36340c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3639600640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36340cec80 0x7f36340c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3639600640 1 -- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f363415f8f0 msgr2=0x7f36341e76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3639600640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f363415f8f0 0x7f36341e76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3639600640 1 -- 172.21.15.100:0/1597456831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36340c84d0 con 0x7f36340aea30 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.531+0000 7f3639600640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36340aea30 0x7f36341f2eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3628000f80 tx=0x7f3628003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.532+0000 7f3631600640 1 -- 172.21.15.100:0/1597456831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628046070 con 0x7f36340aea30 2024-09-10T21:07:34.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.532+0000 7f3631600640 1 -- 172.21.15.100:0/1597456831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3628004250 con 0x7f36340aea30 2024-09-10T21:07:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.532+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36341e8780 con 0x7f36340aea30 2024-09-10T21:07:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.532+0000 7f3631600640 1 -- 172.21.15.100:0/1597456831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628004660 con 0x7f36340aea30 2024-09-10T21:07:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.532+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36340c8a20 con 0x7f36340aea30 2024-09-10T21:07:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.533+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36340cc820 con 0x7f36340aea30 2024-09-10T21:07:34.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.534+0000 7f3631600640 1 -- 172.21.15.100:0/1597456831 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f362804b440 con 0x7f36340aea30 2024-09-10T21:07:34.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.535+0000 7f3631600640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3614077fa0 0x7f361407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.535+0000 7f3631600640 1 -- 172.21.15.100:0/1597456831 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f36280bafe0 con 0x7f36340aea30 2024-09-10T21:07:34.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.535+0000 7f3638c00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3614077fa0 0x7f361407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.536+0000 7f3638c00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3614077fa0 0x7f361407a460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f36340b54b0 tx=0x7f3620009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.539+0000 7f3631600640 1 -- 172.21.15.100:0/1597456831 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3628032030 con 0x7f36340aea30 2024-09-10T21:07:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.756+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36340c8bf0 con 0x7f36340aea30 2024-09-10T21:07:34.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.757+0000 7f3631600640 1 -- 172.21.15.100:0/1597456831 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f36280832f0 con 0x7f36340aea30 2024-09-10T21:07:34.760 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:34.761 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"btime":"2024-09-10T21:07:11:987578+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3760826970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3760826970},{"type":"v1","addr":"172.21.15.100:6834","nonce":3760826970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2104919496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2104919496},{"type":"v1","addr":"172.21.15.130:6837","nonce":2104919496}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2076530872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2076530872},{"type":"v1","addr":"172.21.15.100:6835","nonce":2076530872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:07:08.380674+0000","modified":"2024-09-10T21:07:11.401889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/772903553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":772903553},{"type":"v1","addr":"172.21.15.130:6836","nonce":772903553}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-09-10T21:07:34.761 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-10T21:07:34.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3614077fa0 msgr2=0x7f361407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3614077fa0 0x7f361407a460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f36340b54b0 tx=0x7f3620009040 comp rx=0 tx=0).stop 2024-09-10T21:07:34.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36340aea30 msgr2=0x7f36341f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36340aea30 0x7f36341f2eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3628000f80 tx=0x7f3628003ce0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 shutdown_connections 2024-09-10T21:07:34.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3614077fa0 0x7f361407a460 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f363415f8f0 0x7f36341e76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36340cec80 0x7f36340c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 --2- 172.21.15.100:0/1597456831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36340aea30 0x7f36341f2eb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 >> 172.21.15.100:0/1597456831 conn(0x7f363406d500 msgr2=0x7f36340b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 shutdown_connections 2024-09-10T21:07:34.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.759+0000 7f363aa00640 1 -- 172.21.15.100:0/1597456831 wait complete. 2024-09-10T21:07:34.779 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:07:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.934+0000 7fe46d400640 1 -- 172.21.15.100:0/2841930989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe44c004d40 msgr2=0x7fe44c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.934+0000 7fe46d400640 1 --2- 172.21.15.100:0/2841930989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe44c004d40 0x7fe44c0051c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe4680d2470 tx=0x7fe44c005830 comp rx=0 tx=0).stop 2024-09-10T21:07:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.934+0000 7fe46ca00640 1 -- 172.21.15.100:0/2841930989 reap_dead start 2024-09-10T21:07:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.934+0000 7fe46d400640 1 -- 172.21.15.100:0/2841930989 shutdown_connections 2024-09-10T21:07:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.934+0000 7fe46d400640 1 -- 172.21.15.100:0/2841930989 >> 172.21.15.100:0/2841930989 conn(0x7fe46809a9e0 msgr2=0x7fe46809adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.934+0000 7fe46d400640 1 -- 172.21.15.100:0/2841930989 shutdown_connections 2024-09-10T21:07:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.934+0000 7fe46d400640 1 -- 172.21.15.100:0/2841930989 wait complete. 2024-09-10T21:07:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.936+0000 7fe46d400640 1 Processor -- start 2024-09-10T21:07:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.936+0000 7fe46d400640 1 -- start start 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe46d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe44c004d40 0x7fe4680b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe46d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4680ca8e0 0x7fe4680b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe46d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4680cad60 0x7fe4680b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe46d400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe4680cff50 con 0x7fe4680ca8e0 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe46d400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe4680cfdd0 con 0x7fe44c004d40 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe46d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe4680d00d0 con 0x7fe4680cad60 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4680ca8e0 0x7fe4680b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4680ca8e0 0x7fe4680b6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59822/0 (socket says 172.21.15.100:59822) 2024-09-10T21:07:34.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467400640 1 -- 172.21.15.100:0/3242075990 learned_addr learned my addr 172.21.15.100:0/3242075990 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467e00640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe44c004d40 0x7fe4680b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe46ca00640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4680cad60 0x7fe4680b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467400640 1 -- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4680cad60 msgr2=0x7fe4680b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4680cad60 0x7fe4680b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467400640 1 -- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe44c004d40 msgr2=0x7fe4680b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe44c004d40 0x7fe4680b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.937+0000 7fe467400640 1 -- 172.21.15.100:0/3242075990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4680cb330 con 0x7fe4680ca8e0 2024-09-10T21:07:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.938+0000 7fe467400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4680ca8e0 0x7fe4680b6940 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe454001710 tx=0x7fe4540039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.938+0000 7fe45fe00640 1 -- 172.21.15.100:0/3242075990 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454015070 con 0x7fe4680ca8e0 2024-09-10T21:07:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.938+0000 7fe45fe00640 1 -- 172.21.15.100:0/3242075990 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe454011900 con 0x7fe4680ca8e0 2024-09-10T21:07:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.938+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4680b1450 con 0x7fe4680ca8e0 2024-09-10T21:07:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.938+0000 7fe45fe00640 1 -- 172.21.15.100:0/3242075990 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454011d30 con 0x7fe4680ca8e0 2024-09-10T21:07:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.938+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4680b4100 con 0x7fe4680ca8e0 2024-09-10T21:07:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.939+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe468071300 con 0x7fe4680ca8e0 2024-09-10T21:07:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.940+0000 7fe45fe00640 1 -- 172.21.15.100:0/3242075990 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe4540233a0 con 0x7fe4680ca8e0 2024-09-10T21:07:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.941+0000 7fe45fe00640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe448077fa0 0x7fe44807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.941+0000 7fe45fe00640 1 -- 172.21.15.100:0/3242075990 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe45409aec0 con 0x7fe4680ca8e0 2024-09-10T21:07:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.942+0000 7fe467e00640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe448077fa0 0x7fe44807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:34.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.942+0000 7fe467e00640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe448077fa0 0x7fe44807a460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe458009cd0 tx=0x7fe458005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:34.945+0000 7fe45fe00640 1 -- 172.21.15.100:0/3242075990 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe454063150 con 0x7fe4680ca8e0 2024-09-10T21:07:35.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.162+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe46815c910 con 0x7fe4680ca8e0 2024-09-10T21:07:35.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.163+0000 7fe45fe00640 1 -- 172.21.15.100:0/3242075990 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7fe454067b80 con 0x7fe4680ca8e0 2024-09-10T21:07:35.167 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:35.167 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"btime":"2024-09-10T21:07:11:987578+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3760826970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3760826970},{"type":"v1","addr":"172.21.15.100:6834","nonce":3760826970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2104919496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2104919496},{"type":"v1","addr":"172.21.15.130:6837","nonce":2104919496}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2076530872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2076530872},{"type":"v1","addr":"172.21.15.100:6835","nonce":2076530872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T21:07:08.380674+0000","modified":"2024-09-10T21:07:11.401889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6836/772903553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":772903553},{"type":"v1","addr":"172.21.15.130:6836","nonce":772903553}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-09-10T21:07:35.167 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-10T21:07:35.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe448077fa0 msgr2=0x7fe44807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe448077fa0 0x7fe44807a460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe458009cd0 tx=0x7fe458005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:35.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4680ca8e0 msgr2=0x7fe4680b6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4680ca8e0 0x7fe4680b6940 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe454001710 tx=0x7fe4540039c0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 shutdown_connections 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4680cad60 0x7fe4680b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4680ca8e0 0x7fe4680b6940 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe448077fa0 0x7fe44807a460 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 --2- 172.21.15.100:0/3242075990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe44c004d40 0x7fe4680b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.165+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 >> 172.21.15.100:0/3242075990 conn(0x7fe46809a9e0 msgr2=0x7fe4680704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.166+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 shutdown_connections 2024-09-10T21:07:35.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.166+0000 7fe46d400640 1 -- 172.21.15.100:0/3242075990 wait complete. 2024-09-10T21:07:35.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:07:35.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 -- 172.21.15.100:0/1232367706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde540741e0 msgr2=0x7fde5415f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 --2- 172.21.15.100:0/1232367706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde540741e0 0x7fde5415f4d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fde54070770 tx=0x7fde4002a560 comp rx=0 tx=0).stop 2024-09-10T21:07:35.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 -- 172.21.15.100:0/1232367706 shutdown_connections 2024-09-10T21:07:35.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 --2- 172.21.15.100:0/1232367706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde5415c750 0x7fde540cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 --2- 172.21.15.100:0/1232367706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde540741e0 0x7fde5415f4d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 --2- 172.21.15.100:0/1232367706 >> v2:172.21.15.130:3300/0 conn(0x7fde5415b680 0x7fde5415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 -- 172.21.15.100:0/1232367706 >> 172.21.15.100:0/1232367706 conn(0x7fde5406cb50 msgr2=0x7fde5406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:35.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 -- 172.21.15.100:0/1232367706 shutdown_connections 2024-09-10T21:07:35.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.339+0000 7fde5b600640 1 -- 172.21.15.100:0/1232367706 wait complete. 2024-09-10T21:07:35.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.341+0000 7fde5b600640 1 Processor -- start 2024-09-10T21:07:35.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.341+0000 7fde5b600640 1 -- start start 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde5b600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540741e0 0x7fde541f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde5b600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5415b680 0x7fde541f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde5b600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde5415c750 0x7fde540c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde5b600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fde540d00d0 con 0x7fde5415c750 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde5b600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fde540cff50 con 0x7fde5415b680 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde5b600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fde540b2860 con 0x7fde540741e0 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde59600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde5415c750 0x7fde540c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde58c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540741e0 0x7fde541f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde59600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde5415c750 0x7fde540c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59830/0 (socket says 172.21.15.100:59830) 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde59600640 1 -- 172.21.15.100:0/451151526 learned_addr learned my addr 172.21.15.100:0/451151526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde53e00640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5415b680 0x7fde541f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde59600640 1 -- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540741e0 msgr2=0x7fde541f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde59600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540741e0 0x7fde541f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde59600640 1 -- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5415b680 msgr2=0x7fde541f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde59600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5415b680 0x7fde541f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.342+0000 7fde59600640 1 -- 172.21.15.100:0/451151526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde54158d10 con 0x7fde5415c750 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.343+0000 7fde59600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde5415c750 0x7fde540c47d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00e960 tx=0x7fde4c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.343+0000 7fde50c00640 1 -- 172.21.15.100:0/451151526 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c004d20 con 0x7fde5415c750 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.343+0000 7fde50c00640 1 -- 172.21.15.100:0/451151526 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde4c00cb20 con 0x7fde5415c750 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.343+0000 7fde50c00640 1 -- 172.21.15.100:0/451151526 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c005020 con 0x7fde5415c750 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.343+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde54158f80 con 0x7fde5415c750 2024-09-10T21:07:35.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.343+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde541f5900 con 0x7fde5415c750 2024-09-10T21:07:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.344+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5415ba60 con 0x7fde5415c750 2024-09-10T21:07:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.345+0000 7fde50c00640 1 -- 172.21.15.100:0/451151526 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fde4c00f040 con 0x7fde5415c750 2024-09-10T21:07:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.347+0000 7fde50c00640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fde34077f70 0x7fde3407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.347+0000 7fde50c00640 1 -- 172.21.15.100:0/451151526 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fde4c09a460 con 0x7fde5415c750 2024-09-10T21:07:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.348+0000 7fde58c00640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fde34077f70 0x7fde3407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.348+0000 7fde58c00640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fde34077f70 0x7fde3407a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde4800bb70 tx=0x7fde4800b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:35.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.351+0000 7fde50c00640 1 -- 172.21.15.100:0/451151526 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fde4c016030 con 0x7fde5415c750 2024-09-10T21:07:35.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.534+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde540cf940 con 0x7fde5415c750 2024-09-10T21:07:35.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.535+0000 7fde50c00640 1 -- 172.21.15.100:0/451151526 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17026 (secure 0 0 0) 0x7fde4c062770 con 0x7fde5415c750 2024-09-10T21:07:35.539 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:35.539 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:07:09.973363+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:07:06.699580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T21:07:07.345691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:07:35.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.537+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fde34077f70 msgr2=0x7fde3407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.537+0000 7fde5b600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fde34077f70 0x7fde3407a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde4800bb70 tx=0x7fde4800b2e0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.537+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde5415c750 msgr2=0x7fde540c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.537+0000 7fde5b600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde5415c750 0x7fde540c47d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00e960 tx=0x7fde4c00ee20 comp rx=0 tx=0).stop 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.538+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 shutdown_connections 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.538+0000 7fde5b600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde5415c750 0x7fde540c47d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.538+0000 7fde5b600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fde34077f70 0x7fde3407a430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.538+0000 7fde5b600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5415b680 0x7fde541f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.538+0000 7fde5b600640 1 --2- 172.21.15.100:0/451151526 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540741e0 0x7fde541f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.538+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 >> 172.21.15.100:0/451151526 conn(0x7fde5406cb50 msgr2=0x7fde5406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.538+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 shutdown_connections 2024-09-10T21:07:35.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.538+0000 7fde5b600640 1 -- 172.21.15.100:0/451151526 wait complete. 2024-09-10T21:07:35.557 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T21:07:35.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.710+0000 7fbb06c00640 1 -- 172.21.15.100:0/1835025221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb000cf810 msgr2=0x7fbb00161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.710+0000 7fbb06c00640 1 --2- 172.21.15.100:0/1835025221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb000cf810 0x7fbb00161640 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbaec005fd0 tx=0x7fbaec02a5c0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.710+0000 7fbb06c00640 1 -- 172.21.15.100:0/1835025221 shutdown_connections 2024-09-10T21:07:35.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.710+0000 7fbb06c00640 1 --2- 172.21.15.100:0/1835025221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb0006eb60 0x7fbb0006efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.710+0000 7fbb06c00640 1 --2- 172.21.15.100:0/1835025221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb000cf810 0x7fbb00161640 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.710+0000 7fbb06c00640 1 -- 172.21.15.100:0/1835025221 >> 172.21.15.100:0/1835025221 conn(0x7fbb0006cb50 msgr2=0x7fbb0006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:35.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.710+0000 7fbb06c00640 1 -- 172.21.15.100:0/1835025221 shutdown_connections 2024-09-10T21:07:35.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.710+0000 7fbb06c00640 1 -- 172.21.15.100:0/1835025221 wait complete. 2024-09-10T21:07:35.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.712+0000 7fbb06c00640 1 Processor -- start 2024-09-10T21:07:35.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.712+0000 7fbb06c00640 1 -- start start 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbb06c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0006eb60 0x7fbb000ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbb06c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb000cf810 0x7fbb000b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbb06c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb0015b4d0 0x7fbb001f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbb06c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb000b2de0 con 0x7fbb0006eb60 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbb06c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbb000b2c60 con 0x7fbb0015b4d0 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbb06c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbb000b2f60 con 0x7fbb000cf810 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbaffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0006eb60 0x7fbb000ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbaffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0006eb60 0x7fbb000ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59854/0 (socket says 172.21.15.100:59854) 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbaffe00640 1 -- 172.21.15.100:0/2277363025 learned_addr learned my addr 172.21.15.100:0/2277363025 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbaff400640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb000cf810 0x7fbb000b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.713+0000 7fbb04c00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb0015b4d0 0x7fbb001f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaffe00640 1 -- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb000cf810 msgr2=0x7fbb000b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaffe00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb000cf810 0x7fbb000b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaffe00640 1 -- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb0015b4d0 msgr2=0x7fbb001f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaffe00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb0015b4d0 0x7fbb001f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaffe00640 1 -- 172.21.15.100:0/2277363025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb000b0da0 con 0x7fbb0006eb60 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaff400640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb000cf810 0x7fbb000b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbb04c00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb0015b4d0 0x7fbb001f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaffe00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0006eb60 0x7fbb000ce760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000b3e0 tx=0x7fbaf000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaf7e00640 1 -- 172.21.15.100:0/2277363025 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0015020 con 0x7fbb0006eb60 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaf7e00640 1 -- 172.21.15.100:0/2277363025 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaf0011940 con 0x7fbb0006eb60 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb000b1080 con 0x7fbb0006eb60 2024-09-10T21:07:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbaf7e00640 1 -- 172.21.15.100:0/2277363025 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0011d90 con 0x7fbb0006eb60 2024-09-10T21:07:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.714+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb000b1640 con 0x7fbb0006eb60 2024-09-10T21:07:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.715+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb000b34e0 con 0x7fbb0006eb60 2024-09-10T21:07:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.716+0000 7fbaf7e00640 1 -- 172.21.15.100:0/2277363025 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbaf001a400 con 0x7fbb0006eb60 2024-09-10T21:07:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.717+0000 7fbaf7e00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbae0077f70 0x7fbae007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.717+0000 7fbaf7e00640 1 -- 172.21.15.100:0/2277363025 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fbaf009a300 con 0x7fbb0006eb60 2024-09-10T21:07:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.718+0000 7fbaff400640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbae0077f70 0x7fbae007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.718+0000 7fbaff400640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbae0077f70 0x7fbae007a430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbaec033000 tx=0x7fbaec004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.721+0000 7fbaf7e00640 1 -- 172.21.15.100:0/2277363025 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbaf001f020 con 0x7fbb0006eb60 2024-09-10T21:07:35.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.940+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbb000727e0 con 0x7fbb0006eb60 2024-09-10T21:07:35.944 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-09-10T21:07:35.940+0000 7f3d5ea00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:07:35.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.942+0000 7fbaf7e00640 1 -- 172.21.15.100:0/2277363025 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fbaf0062bd0 con 0x7fbb0006eb60 2024-09-10T21:07:35.946 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T21:07:35.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.945+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbae0077f70 msgr2=0x7fbae007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.945+0000 7fbb06c00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbae0077f70 0x7fbae007a430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbaec033000 tx=0x7fbaec004730 comp rx=0 tx=0).stop 2024-09-10T21:07:35.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.945+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0006eb60 msgr2=0x7fbb000ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.945+0000 7fbb06c00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0006eb60 0x7fbb000ce760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000b3e0 tx=0x7fbaf000b8a0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.946+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 shutdown_connections 2024-09-10T21:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.946+0000 7fbb06c00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbae0077f70 0x7fbae007a430 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.946+0000 7fbb06c00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb0015b4d0 0x7fbb001f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.946+0000 7fbb06c00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb000cf810 0x7fbb000b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.946+0000 7fbb06c00640 1 --2- 172.21.15.100:0/2277363025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0006eb60 0x7fbb000ce760 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.946+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 >> 172.21.15.100:0/2277363025 conn(0x7fbb0006cb50 msgr2=0x7fbb00073dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:35.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.946+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 shutdown_connections 2024-09-10T21:07:35.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:35.947+0000 7fbb06c00640 1 -- 172.21.15.100:0/2277363025 wait complete. 2024-09-10T21:07:35.956 INFO:tasks.ceph.mds.d.smithi130.stderr: -2435> 2024-09-10T21:07:13.817+0000 7f9a7f400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T21:07:35.967 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T21:07:36.004 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2024-09-10T21:07:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.124+0000 7f46e9e00640 1 -- 172.21.15.100:0/3015813562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e40741e0 msgr2=0x7f46e415f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.124+0000 7f46e9e00640 1 --2- 172.21.15.100:0/3015813562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e40741e0 0x7f46e415f4d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f46e40cd2b0 tx=0x7f46d002a530 comp rx=0 tx=0).stop 2024-09-10T21:07:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.124+0000 7f46e9e00640 1 -- 172.21.15.100:0/3015813562 shutdown_connections 2024-09-10T21:07:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.124+0000 7f46e9e00640 1 --2- 172.21.15.100:0/3015813562 >> v2:172.21.15.130:3300/0 conn(0x7f46e415c750 0x7f46e40cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.124+0000 7f46e9e00640 1 --2- 172.21.15.100:0/3015813562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e40741e0 0x7f46e415f4d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.124+0000 7f46e9e00640 1 -- 172.21.15.100:0/3015813562 >> 172.21.15.100:0/3015813562 conn(0x7f46e406cb50 msgr2=0x7f46e406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.124+0000 7f46e9e00640 1 -- 172.21.15.100:0/3015813562 shutdown_connections 2024-09-10T21:07:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.124+0000 7f46e9e00640 1 -- 172.21.15.100:0/3015813562 wait complete. 2024-09-10T21:07:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.126+0000 7f46e9e00640 1 Processor -- start 2024-09-10T21:07:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.126+0000 7f46e9e00640 1 -- start start 2024-09-10T21:07:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e9e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46e40741e0 0x7f46e41f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e415b680 0x7f46e415e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46e415c750 0x7f46e40cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e9e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46e40b2860 con 0x7f46e415b680 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e9e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f46e40d00d0 con 0x7f46e415c750 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e9e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f46e40b29e0 con 0x7f46e40741e0 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e415b680 0x7f46e415e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e415b680 0x7f46e415e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59880/0 (socket says 172.21.15.100:59880) 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e2000640 1 -- 172.21.15.100:0/4092939690 learned_addr learned my addr 172.21.15.100:0/4092939690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e2a00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46e40741e0 0x7f46e41f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.127+0000 7f46e3400640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46e415c750 0x7f46e40cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e2000640 1 -- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46e40741e0 msgr2=0x7f46e41f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e2000640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46e40741e0 0x7f46e41f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e2000640 1 -- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46e415c750 msgr2=0x7f46e40cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e2000640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46e415c750 0x7f46e40cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e2000640 1 -- 172.21.15.100:0/4092939690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e415e870 con 0x7f46e415b680 2024-09-10T21:07:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e2a00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46e40741e0 0x7f46e41f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e2000640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e415b680 0x7f46e415e0d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009780 tx=0x7f46d0032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46db400640 1 -- 172.21.15.100:0/4092939690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0040070 con 0x7f46e415b680 2024-09-10T21:07:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46db400640 1 -- 172.21.15.100:0/4092939690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46d0005310 con 0x7f46e415b680 2024-09-10T21:07:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46db400640 1 -- 172.21.15.100:0/4092939690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d00047a0 con 0x7f46e415b680 2024-09-10T21:07:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e415eb50 con 0x7f46e415b680 2024-09-10T21:07:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.128+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e40cb840 con 0x7f46e415b680 2024-09-10T21:07:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.129+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e41f55b0 con 0x7f46e415b680 2024-09-10T21:07:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.130+0000 7f46db400640 1 -- 172.21.15.100:0/4092939690 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f46d0004940 con 0x7f46e415b680 2024-09-10T21:07:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.131+0000 7f46db400640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f46c4077f70 0x7f46c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.131+0000 7f46db400640 1 -- 172.21.15.100:0/4092939690 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f46d00bb340 con 0x7f46e415b680 2024-09-10T21:07:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.132+0000 7f46e2a00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f46c4077f70 0x7f46c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.132+0000 7f46e2a00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f46c4077f70 0x7f46c407a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f46d40012e0 tx=0x7f46d4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:36.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.135+0000 7f46db400640 1 -- 172.21.15.100:0/4092939690 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f46d0083c50 con 0x7f46e415b680 2024-09-10T21:07:36.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.353+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f46e415f4d0 con 0x7f46e415b680 2024-09-10T21:07:36.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.948+0000 7f46db400640 1 -- 172.21.15.100:0/4092939690 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f46d0083550 con 0x7f46e415b680 2024-09-10T21:07:36.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f46c4077f70 msgr2=0x7f46c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:36.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f46c4077f70 0x7f46c407a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f46d40012e0 tx=0x7f46d4009040 comp rx=0 tx=0).stop 2024-09-10T21:07:36.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e415b680 msgr2=0x7f46e415e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:36.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e415b680 0x7f46e415e0d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009780 tx=0x7f46d0032c10 comp rx=0 tx=0).stop 2024-09-10T21:07:36.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 shutdown_connections 2024-09-10T21:07:36.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f46c4077f70 0x7f46c407a430 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:36.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46e415c750 0x7f46e40cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:36.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46e415b680 0x7f46e415e0d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:36.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 --2- 172.21.15.100:0/4092939690 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46e40741e0 0x7f46e41f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:36.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 >> 172.21.15.100:0/4092939690 conn(0x7f46e406cb50 msgr2=0x7f46e40aed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:36.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 shutdown_connections 2024-09-10T21:07:36.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:36.950+0000 7f46e9e00640 1 -- 172.21.15.100:0/4092939690 wait complete. 2024-09-10T21:07:36.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.129+0000 7f7f0a000640 1 -- 172.21.15.100:0/2807336505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee8004d40 msgr2=0x7f7ee80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.129+0000 7f7f0a000640 1 --2- 172.21.15.100:0/2807336505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee8004d40 0x7f7ee80051c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c730 tx=0x7f7ee8005830 comp rx=0 tx=0).stop 2024-09-10T21:07:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.129+0000 7f7f03e00640 1 -- 172.21.15.100:0/2807336505 reap_dead start 2024-09-10T21:07:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.129+0000 7f7f0a000640 1 -- 172.21.15.100:0/2807336505 shutdown_connections 2024-09-10T21:07:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.129+0000 7f7f0a000640 1 -- 172.21.15.100:0/2807336505 >> 172.21.15.100:0/2807336505 conn(0x7f7f0406cb50 msgr2=0x7f7f0406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.129+0000 7f7f0a000640 1 -- 172.21.15.100:0/2807336505 shutdown_connections 2024-09-10T21:07:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.130+0000 7f7f0a000640 1 -- 172.21.15.100:0/2807336505 wait complete. 2024-09-10T21:07:37.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.131+0000 7f7f0a000640 1 Processor -- start 2024-09-10T21:07:37.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.131+0000 7f7f0a000640 1 -- start start 2024-09-10T21:07:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f0a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee8004d40 0x7f7f04155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f0a000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f04152240 0x7f7f04150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f04153770 0x7f7f040b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f0a000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f040b32a0 con 0x7f7f04153770 2024-09-10T21:07:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f0a000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f040b3120 con 0x7f7ee8004d40 2024-09-10T21:07:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f0a000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7f040b3420 con 0x7f7f04152240 2024-09-10T21:07:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f03e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f04153770 0x7f7f040b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:37.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f03e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f04153770 0x7f7f040b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59884/0 (socket says 172.21.15.100:59884) 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f03e00640 1 -- 172.21.15.100:0/2273637507 learned_addr learned my addr 172.21.15.100:0/2273637507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.132+0000 7f7f03400640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee8004d40 0x7f7f04155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f02a00640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f04152240 0x7f7f04150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f03e00640 1 -- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f04152240 msgr2=0x7f7f04150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f03e00640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f04152240 0x7f7f04150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f03e00640 1 -- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee8004d40 msgr2=0x7f7f04155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f03e00640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee8004d40 0x7f7f04155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f03e00640 1 -- 172.21.15.100:0/2273637507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f04150b60 con 0x7f7f04153770 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f02a00640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f04152240 0x7f7f04150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f03e00640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f04153770 0x7f7f040b19d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c310 tx=0x7f7efc00c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7efb400640 1 -- 172.21.15.100:0/2273637507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc001510 con 0x7f7f04153770 2024-09-10T21:07:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7efb400640 1 -- 172.21.15.100:0/2273637507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7efc02b940 con 0x7f7f04153770 2024-09-10T21:07:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7efb400640 1 -- 172.21.15.100:0/2273637507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc02bd10 con 0x7f7f04153770 2024-09-10T21:07:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.133+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f04153fc0 con 0x7f7f04153770 2024-09-10T21:07:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.134+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f040af7a0 con 0x7f7f04153770 2024-09-10T21:07:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.135+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0415ea60 con 0x7f7f04153770 2024-09-10T21:07:37.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.136+0000 7f7efb400640 1 -- 172.21.15.100:0/2273637507 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7efc048060 con 0x7f7f04153770 2024-09-10T21:07:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.137+0000 7f7efb400640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ee4077f70 0x7f7ee407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.137+0000 7f7efb400640 1 -- 172.21.15.100:0/2273637507 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6187+0+0 (secure 0 0 0) 0x7f7efc03b030 con 0x7f7f04153770 2024-09-10T21:07:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.138+0000 7f7f03400640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ee4077f70 0x7f7ee407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:37.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.138+0000 7f7f03400640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ee4077f70 0x7f7ee407a430 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009cd0 tx=0x7f7ef4005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:37.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.141+0000 7f7efb400640 1 -- 172.21.15.100:0/2273637507 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7f0415efa0 con 0x7f7f04153770 2024-09-10T21:07:37.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.326+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f040b4770 con 0x7f7f04153770 2024-09-10T21:07:37.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.950+0000 7f7efb400640 1 -- 172.21.15.100:0/2273637507 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) ==== 181+0+0 (secure 0 0 0) 0x7f7efc081fb0 con 0x7f7f04153770 2024-09-10T21:07:37.954 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ee4077f70 msgr2=0x7f7ee407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ee4077f70 0x7f7ee407a430 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009cd0 tx=0x7f7ef4005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f04153770 msgr2=0x7f7f040b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f04153770 0x7f7f040b19d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00c310 tx=0x7f7efc00c3f0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 shutdown_connections 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f04153770 0x7f7f040b19d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f04152240 0x7f7f04150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f7ee4077f70 0x7f7ee407a430 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 --2- 172.21.15.100:0/2273637507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee8004d40 0x7f7f04155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 >> 172.21.15.100:0/2273637507 conn(0x7f7f0406cb50 msgr2=0x7f7f0415d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:37.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 shutdown_connections 2024-09-10T21:07:37.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:37.954+0000 7f7f0a000640 1 -- 172.21.15.100:0/2273637507 wait complete. 2024-09-10T21:07:37.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T21:07:38.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.140+0000 7f2b4d600640 1 -- 172.21.15.100:0/2551073278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b2c004d40 msgr2=0x7f2b2c0051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:38.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.140+0000 7f2b4d600640 1 --2- 172.21.15.100:0/2551073278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b2c004d40 0x7f2b2c0051a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009ed0 tx=0x7f2b2c005830 comp rx=0 tx=0).stop 2024-09-10T21:07:38.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.140+0000 7f2b47400640 1 -- 172.21.15.100:0/2551073278 reap_dead start 2024-09-10T21:07:38.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.140+0000 7f2b4d600640 1 -- 172.21.15.100:0/2551073278 shutdown_connections 2024-09-10T21:07:38.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.140+0000 7f2b4d600640 1 -- 172.21.15.100:0/2551073278 >> 172.21.15.100:0/2551073278 conn(0x7f2b4806cb50 msgr2=0x7f2b4806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:38.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.140+0000 7f2b4d600640 1 -- 172.21.15.100:0/2551073278 shutdown_connections 2024-09-10T21:07:38.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.141+0000 7f2b4d600640 1 -- 172.21.15.100:0/2551073278 wait complete. 2024-09-10T21:07:38.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.142+0000 7f2b4d600640 1 Processor -- start 2024-09-10T21:07:38.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.142+0000 7f2b4d600640 1 -- start start 2024-09-10T21:07:38.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b4d600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b2c004d40 0x7f2b4815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:38.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b4d600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b48154220 0x7f2b4814b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b4d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b480ab750 0x7f2b480abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b4d600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b480cfef0 con 0x7f2b480ab750 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b4d600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b480cfd70 con 0x7f2b48154220 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b4d600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2b480d0070 con 0x7f2b2c004d40 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b47400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b480ab750 0x7f2b480abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b47400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b480ab750 0x7f2b480abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59894/0 (socket says 172.21.15.100:59894) 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.143+0000 7f2b47400640 1 -- 172.21.15.100:0/3554340842 learned_addr learned my addr 172.21.15.100:0/3554340842 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b3fe00640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b48154220 0x7f2b4814b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b46a00640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b2c004d40 0x7f2b4815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b47400640 1 -- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b2c004d40 msgr2=0x7f2b4815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b47400640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b2c004d40 0x7f2b4815a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b47400640 1 -- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b48154220 msgr2=0x7f2b4814b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:38.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b47400640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b48154220 0x7f2b4814b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b47400640 1 -- 172.21.15.100:0/3554340842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4814b6e0 con 0x7f2b480ab750 2024-09-10T21:07:38.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b47400640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b480ab750 0x7f2b480abbe0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b40036040 tx=0x7f2b40034c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:38.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b3ea00640 1 -- 172.21.15.100:0/3554340842 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40043070 con 0x7f2b480ab750 2024-09-10T21:07:38.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b3ea00640 1 -- 172.21.15.100:0/3554340842 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b40034cf0 con 0x7f2b480ab750 2024-09-10T21:07:38.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b480aa0a0 con 0x7f2b480ab750 2024-09-10T21:07:38.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b3ea00640 1 -- 172.21.15.100:0/3554340842 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40038040 con 0x7f2b480ab750 2024-09-10T21:07:38.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.144+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b480aa660 con 0x7f2b480ab750 2024-09-10T21:07:38.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.145+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b4815f4d0 con 0x7f2b480ab750 2024-09-10T21:07:38.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.147+0000 7f2b3ea00640 1 -- 172.21.15.100:0/3554340842 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2b4003b050 con 0x7f2b480ab750 2024-09-10T21:07:38.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.147+0000 7f2b3ea00640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2b24077fa0 0x7f2b2407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:38.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.148+0000 7f2b3ea00640 1 -- 172.21.15.100:0/3554340842 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5749+0+0 (secure 0 0 0) 0x7f2b400b9b00 con 0x7f2b480ab750 2024-09-10T21:07:38.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.148+0000 7f2b46a00640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2b24077fa0 0x7f2b2407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:38.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.148+0000 7f2b46a00640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2b24077fa0 0x7f2b2407a460 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2b38001eb0 tx=0x7f2b38001640 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:38.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.152+0000 7f2b3ea00640 1 -- 172.21.15.100:0/3554340842 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2b40081e50 con 0x7f2b480ab750 2024-09-10T21:07:38.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.334+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2b480cc490 con 0x7f2b480ab750 2024-09-10T21:07:38.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.958+0000 7f2b3ea00640 1 -- 172.21.15.100:0/3554340842 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) ==== 169+0+0 (secure 0 0 0) 0x7f2b400b9e20 con 0x7f2b480ab750 2024-09-10T21:07:38.962 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-09-10T21:07:38.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2b24077fa0 msgr2=0x7f2b2407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:38.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2b24077fa0 0x7f2b2407a460 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2b38001eb0 tx=0x7f2b38001640 comp rx=0 tx=0).stop 2024-09-10T21:07:38.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b480ab750 msgr2=0x7f2b480abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:38.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b480ab750 0x7f2b480abbe0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2b40036040 tx=0x7f2b40034c00 comp rx=0 tx=0).stop 2024-09-10T21:07:38.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 shutdown_connections 2024-09-10T21:07:38.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b480ab750 0x7f2b480abbe0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2b24077fa0 0x7f2b2407a460 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b48154220 0x7f2b4814b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 --2- 172.21.15.100:0/3554340842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b2c004d40 0x7f2b4815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.963+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 >> 172.21.15.100:0/3554340842 conn(0x7f2b4806cb50 msgr2=0x7f2b480cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:38.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.964+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 shutdown_connections 2024-09-10T21:07:38.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:38.966+0000 7f2b4d600640 1 -- 172.21.15.100:0/3554340842 wait complete. 2024-09-10T21:07:38.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T21:07:39.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.144+0000 7fc609400640 1 -- 172.21.15.100:0/2555825316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 msgr2=0x7fc60415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.144+0000 7fc609400640 1 --2- 172.21.15.100:0/2555825316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 0x7fc60415ba60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc6040cd2b0 tx=0x7fc5f402a980 comp rx=0 tx=0).stop 2024-09-10T21:07:39.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.144+0000 7fc609400640 1 -- 172.21.15.100:0/2555825316 shutdown_connections 2024-09-10T21:07:39.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.144+0000 7fc609400640 1 --2- 172.21.15.100:0/2555825316 >> v2:172.21.15.130:3300/0 conn(0x7fc60415c750 0x7fc6040cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.144+0000 7fc609400640 1 --2- 172.21.15.100:0/2555825316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 0x7fc60415ba60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.144+0000 7fc609400640 1 -- 172.21.15.100:0/2555825316 >> 172.21.15.100:0/2555825316 conn(0x7fc60406cb50 msgr2=0x7fc60406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:39.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.144+0000 7fc609400640 1 -- 172.21.15.100:0/2555825316 shutdown_connections 2024-09-10T21:07:39.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.144+0000 7fc609400640 1 -- 172.21.15.100:0/2555825316 wait complete. 2024-09-10T21:07:39.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.146+0000 7fc609400640 1 Processor -- start 2024-09-10T21:07:39.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.146+0000 7fc609400640 1 -- start start 2024-09-10T21:07:39.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc609400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6040741e0 0x7fc60413e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc609400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 0x7fc604158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc609400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60415c750 0x7fc6041590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc609400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040b2860 con 0x7fc60415b680 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc609400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc6040b29e0 con 0x7fc60415c750 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc609400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc6040b2b60 con 0x7fc6040741e0 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc601e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 0x7fc604158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc601e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 0x7fc604158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59908/0 (socket says 172.21.15.100:59908) 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc601e00640 1 -- 172.21.15.100:0/222450636 learned_addr learned my addr 172.21.15.100:0/222450636 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc603200640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60415c750 0x7fc6041590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc602800640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6040741e0 0x7fc60413e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc601e00640 1 -- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6040741e0 msgr2=0x7fc60413e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc601e00640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6040741e0 0x7fc60413e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc601e00640 1 -- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60415c750 msgr2=0x7fc6041590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc601e00640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60415c750 0x7fc6041590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc601e00640 1 -- 172.21.15.100:0/222450636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60413eeb0 con 0x7fc60415b680 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.147+0000 7fc602800640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6040741e0 0x7fc60413e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.148+0000 7fc601e00640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 0x7fc604158b70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000c410 tx=0x7fc5f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.148+0000 7fc5faa00640 1 -- 172.21.15.100:0/222450636 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0017070 con 0x7fc60415b680 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.148+0000 7fc5faa00640 1 -- 172.21.15.100:0/222450636 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5f00035f0 con 0x7fc60415b680 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.148+0000 7fc5faa00640 1 -- 172.21.15.100:0/222450636 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0003a40 con 0x7fc60415b680 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.148+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60413f1c0 con 0x7fc60415b680 2024-09-10T21:07:39.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.148+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc604154d40 con 0x7fc60415b680 2024-09-10T21:07:39.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.149+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6040b3080 con 0x7fc60415b680 2024-09-10T21:07:39.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.150+0000 7fc5faa00640 1 -- 172.21.15.100:0/222450636 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc5f0003be0 con 0x7fc60415b680 2024-09-10T21:07:39.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.152+0000 7fc5faa00640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5e4077f70 0x7fc5e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:39.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.152+0000 7fc5faa00640 1 -- 172.21.15.100:0/222450636 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fc5f0098e90 con 0x7fc60415b680 2024-09-10T21:07:39.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.152+0000 7fc602800640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5e4077f70 0x7fc5e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:39.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.153+0000 7fc602800640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5e4077f70 0x7fc5e407a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4035000 tx=0x7fc5f4004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:39.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.156+0000 7fc5faa00640 1 -- 172.21.15.100:0/222450636 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc5f0061af0 con 0x7fc60415b680 2024-09-10T21:07:39.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.343+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fc6040cc490 con 0x7fc60415b680 2024-09-10T21:07:39.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.347+0000 7fc5faa00640 1 -- 172.21.15.100:0/222450636 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7fc5f009a080 con 0x7fc60415b680 2024-09-10T21:07:39.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5e4077f70 msgr2=0x7fc5e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5e4077f70 0x7fc5e407a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4035000 tx=0x7fc5f4004ab0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 msgr2=0x7fc604158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 0x7fc604158b70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000c410 tx=0x7fc5f000c8d0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 shutdown_connections 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fc5e4077f70 0x7fc5e407a430 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60415c750 0x7fc6041590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc60415b680 0x7fc604158b70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.349+0000 7fc609400640 1 --2- 172.21.15.100:0/222450636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6040741e0 0x7fc60413e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.350+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 >> 172.21.15.100:0/222450636 conn(0x7fc60406cb50 msgr2=0x7fc6040b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.350+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 shutdown_connections 2024-09-10T21:07:39.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.350+0000 7fc609400640 1 -- 172.21.15.100:0/222450636 wait complete. 2024-09-10T21:07:39.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_readahead.TestReadahead.test_flush' 2024-09-10T21:07:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.524+0000 7fac95600640 1 -- 172.21.15.100:0/2986565974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 msgr2=0x7fac7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.524+0000 7fac95600640 1 --2- 172.21.15.100:0/2986565974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 0x7fac7400b9c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fac900b5360 tx=0x7fac74005830 comp rx=0 tx=0).stop 2024-09-10T21:07:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.524+0000 7fac94c00640 1 -- 172.21.15.100:0/2986565974 reap_dead start 2024-09-10T21:07:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.524+0000 7fac95600640 1 -- 172.21.15.100:0/2986565974 shutdown_connections 2024-09-10T21:07:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.524+0000 7fac95600640 1 -- 172.21.15.100:0/2986565974 >> 172.21.15.100:0/2986565974 conn(0x7fac9006d500 msgr2=0x7fac900b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.524+0000 7fac95600640 1 -- 172.21.15.100:0/2986565974 shutdown_connections 2024-09-10T21:07:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.524+0000 7fac95600640 1 -- 172.21.15.100:0/2986565974 wait complete. 2024-09-10T21:07:39.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.525+0000 7fac95600640 1 Processor -- start 2024-09-10T21:07:39.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.525+0000 7fac95600640 1 -- start start 2024-09-10T21:07:39.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.526+0000 7fac95600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 0x7fac901f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:39.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.526+0000 7fac95600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac900c9570 0x7fac900b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:39.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.526+0000 7fac95600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90154e70 0x7fac901552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:39.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.526+0000 7fac95600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac9015fee0 con 0x7fac740052e0 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.526+0000 7fac95600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac9015fd60 con 0x7fac90154e70 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.526+0000 7fac95600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fac90160060 con 0x7fac900c9570 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 0x7fac901f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 0x7fac901f58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59922/0 (socket says 172.21.15.100:59922) 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 -- 172.21.15.100:0/3237033737 learned_addr learned my addr 172.21.15.100:0/3237033737 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8f400640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac900c9570 0x7fac900b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac94c00640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90154e70 0x7fac901552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 -- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac900c9570 msgr2=0x7fac900b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac900c9570 0x7fac900b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 -- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90154e70 msgr2=0x7fac901552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90154e70 0x7fac901552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 -- 172.21.15.100:0/3237033737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac900c5660 con 0x7fac740052e0 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac94c00640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90154e70 0x7fac901552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac8fe00640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 0x7fac901f58f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fac80003fa0 tx=0x7fac8000f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.527+0000 7fac87e00640 1 -- 172.21.15.100:0/3237033737 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80015070 con 0x7fac740052e0 2024-09-10T21:07:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.528+0000 7fac87e00640 1 -- 172.21.15.100:0/3237033737 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac80011840 con 0x7fac740052e0 2024-09-10T21:07:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.528+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac900c50a0 con 0x7fac740052e0 2024-09-10T21:07:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.528+0000 7fac87e00640 1 -- 172.21.15.100:0/3237033737 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80011c70 con 0x7fac740052e0 2024-09-10T21:07:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.528+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac901f6130 con 0x7fac740052e0 2024-09-10T21:07:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.529+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac901f6570 con 0x7fac740052e0 2024-09-10T21:07:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.530+0000 7fac87e00640 1 -- 172.21.15.100:0/3237033737 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fac800103c0 con 0x7fac740052e0 2024-09-10T21:07:39.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.531+0000 7fac87e00640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac70077fa0 0x7fac7007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:39.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.531+0000 7fac87e00640 1 -- 172.21.15.100:0/3237033737 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fac8009a730 con 0x7fac740052e0 2024-09-10T21:07:39.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.531+0000 7fac8f400640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac70077fa0 0x7fac7007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:39.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.532+0000 7fac8f400640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac70077fa0 0x7fac7007a460 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac900c9bd0 tx=0x7fac7c0067a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:39.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.535+0000 7fac87e00640 1 -- 172.21.15.100:0/3237033737 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fac80063430 con 0x7fac740052e0 2024-09-10T21:07:39.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.787+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_readahead.TestReadahead.test_flush"]} v 0) -- 0x7fac901f5e30 con 0x7fac740052e0 2024-09-10T21:07:39.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.960+0000 7fac87e00640 1 -- 172.21.15.100:0/3237033737 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_readahead.TestReadahead.test_flush"]}]=0 v107) ==== 131+0+0 (secure 0 0 0) 0x7fac80062d30 con 0x7fac740052e0 2024-09-10T21:07:39.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac70077fa0 msgr2=0x7fac7007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac70077fa0 0x7fac7007a460 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac900c9bd0 tx=0x7fac7c0067a0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 msgr2=0x7fac901f58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 0x7fac901f58f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fac80003fa0 tx=0x7fac8000f7e0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 shutdown_connections 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac70077fa0 0x7fac7007a460 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90154e70 0x7fac901552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac900c9570 0x7fac900b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 --2- 172.21.15.100:0/3237033737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac740052e0 0x7fac901f58f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 >> 172.21.15.100:0/3237033737 conn(0x7fac9006d500 msgr2=0x7fac900ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 shutdown_connections 2024-09-10T21:07:39.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:39.963+0000 7fac95600640 1 -- 172.21.15.100:0/3237033737 wait complete. 2024-09-10T21:07:39.983 INFO:tasks.cephfs_test_runner:test_flush (tasks.cephfs.test_readahead.TestReadahead) ... ok 2024-09-10T21:07:39.983 INFO:tasks.cephfs_test_runner: 2024-09-10T21:07:39.983 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T21:07:39.983 INFO:tasks.cephfs_test_runner:Ran 1 test in 53.435s 2024-09-10T21:07:39.984 INFO:tasks.cephfs_test_runner: 2024-09-10T21:07:39.984 INFO:tasks.cephfs_test_runner:OK 2024-09-10T21:07:39.984 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T21:07:39.996 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T21:07:40.008 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T21:07:40.008 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:07:40.009 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:40.044 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T21:07:40.044 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T21:07:40.044 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:40.119 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T21:07:40.119 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:07:40.119 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:40.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T21:07:40.159 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-10T21:07:40.159 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:40.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T21:07:40.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:40.237 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T21:07:40.272 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T21:07:40.272 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T21:07:40.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:40.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:07:40.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:40.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T21:07:40.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:40.625 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-10T21:07:40.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:40.958 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-09-10T21:07:40.999 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T21:07:40.999 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T21:07:40.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:40.999 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T21:07:41.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:41.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T21:07:41.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:41.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-09-10T21:07:41.689 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T21:07:41.698 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T21:07:41.698 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:41.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.855+0000 7f0129a00640 1 -- 172.21.15.100:0/6218899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0108003a50 msgr2=0x7f0108003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.855+0000 7f0129a00640 1 --2- 172.21.15.100:0/6218899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0108003a50 0x7f0108003e30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0114001760 tx=0x7f0108005830 comp rx=0 tx=0).stop 2024-09-10T21:07:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.855+0000 7f0129000640 1 -- 172.21.15.100:0/6218899 reap_dead start 2024-09-10T21:07:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.856+0000 7f0129a00640 1 -- 172.21.15.100:0/6218899 shutdown_connections 2024-09-10T21:07:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.856+0000 7f0129a00640 1 -- 172.21.15.100:0/6218899 >> 172.21.15.100:0/6218899 conn(0x7f012406d500 msgr2=0x7f01240b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.856+0000 7f0129a00640 1 -- 172.21.15.100:0/6218899 shutdown_connections 2024-09-10T21:07:41.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.856+0000 7f0129a00640 1 -- 172.21.15.100:0/6218899 wait complete. 2024-09-10T21:07:41.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.857+0000 7f0129a00640 1 Processor -- start 2024-09-10T21:07:41.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.857+0000 7f0129a00640 1 -- start start 2024-09-10T21:07:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.858+0000 7f0129a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0108003a50 0x7f0124147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.858+0000 7f0129a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01240afbc0 0x7f012414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.858+0000 7f0129a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124155750 0x7f012414ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.858+0000 7f0129a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f012415fee0 con 0x7f0124155750 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.858+0000 7f0129a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f012415fd60 con 0x7f01240afbc0 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.858+0000 7f0129a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0124160060 con 0x7f0108003a50 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124155750 0x7f012414ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f011b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01240afbc0 0x7f012414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124155750 0x7f012414ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41726/0 (socket says 172.21.15.100:41726) 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 -- 172.21.15.100:0/1345484725 learned_addr learned my addr 172.21.15.100:0/1345484725 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0123e00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0108003a50 0x7f0124147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 -- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0108003a50 msgr2=0x7f0124147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0108003a50 0x7f0124147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 -- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01240afbc0 msgr2=0x7f012414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:41.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01240afbc0 0x7f012414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:41.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 -- 172.21.15.100:0/1345484725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01240b00a0 con 0x7f0124155750 2024-09-10T21:07:41.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.859+0000 7f0129000640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124155750 0x7f012414ac10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f012415fcd0 tx=0x7f011c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.860+0000 7f0120c00640 1 -- 172.21.15.100:0/1345484725 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c004d20 con 0x7f0124155750 2024-09-10T21:07:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.860+0000 7f0120c00640 1 -- 172.21.15.100:0/1345484725 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f011c00e5c0 con 0x7f0124155750 2024-09-10T21:07:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.860+0000 7f0120c00640 1 -- 172.21.15.100:0/1345484725 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c00e9d0 con 0x7f0124155750 2024-09-10T21:07:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.860+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01240b0380 con 0x7f0124155750 2024-09-10T21:07:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.860+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01240b0940 con 0x7f0124155750 2024-09-10T21:07:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.861+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012415bcd0 con 0x7f0124155750 2024-09-10T21:07:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.862+0000 7f0120c00640 1 -- 172.21.15.100:0/1345484725 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f011c00eb70 con 0x7f0124155750 2024-09-10T21:07:41.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.863+0000 7f0120c00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0100077f70 0x7f010007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:41.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.863+0000 7f0120c00640 1 -- 172.21.15.100:0/1345484725 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f011c09a910 con 0x7f0124155750 2024-09-10T21:07:41.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.863+0000 7f0123e00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0100077f70 0x7f010007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:41.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.864+0000 7f0123e00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0100077f70 0x7f010007a430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0114001730 tx=0x7f01140012c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:41.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:41.867+0000 7f0120c00640 1 -- 172.21.15.100:0/1345484725 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f011c062f20 con 0x7f0124155750 2024-09-10T21:07:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.046+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0124148640 con 0x7f0100077f70 2024-09-10T21:07:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.047+0000 7f0120c00640 1 -- 172.21.15.100:0/1345484725 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13421 (secure 0 0 0) 0x7f0114006300 con 0x7f0100077f70 2024-09-10T21:07:42.051 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0100077f70 msgr2=0x7f010007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0100077f70 0x7f010007a430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0114001730 tx=0x7f01140012c0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124155750 msgr2=0x7f012414ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124155750 0x7f012414ac10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f012415fcd0 tx=0x7f011c00f790 comp rx=0 tx=0).stop 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 shutdown_connections 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124155750 0x7f012414ac10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0100077f70 0x7f010007a430 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01240afbc0 0x7f012414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 --2- 172.21.15.100:0/1345484725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0108003a50 0x7f0124147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 >> 172.21.15.100:0/1345484725 conn(0x7f012406d500 msgr2=0x7f012406f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 shutdown_connections 2024-09-10T21:07:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.049+0000 7f0129a00640 1 -- 172.21.15.100:0/1345484725 wait complete. 2024-09-10T21:07:42.069 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-09-10T21:07:40.711029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286644,"kb_used_data":70444,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754688076,"statfs":{"total":773094113280,"available":772800589824,"internally_reserved":0,"allocated":72134656,"data_stored":69930529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33570114,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-32800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001536"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982211+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:09.982211+0000","last_peered":"2024-09-10T21:07:09.982211+0000","last_clean":"2024-09-10T21:07:09.982211+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:09.982211+0000","last_undegraded":"2024-09-10T21:07:09.982211+0000","last_fullsized":"2024-09-10T21:07:09.982211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35676,"kb_used_data":8652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336164,"statfs":{"total":96636764160,"available":96600231936,"internally_reserved":0,"allocated":8859648,"data_stored":8588919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":4556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":4665344,"data_stored":4394579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43896,"kb_used_data":16872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327944,"statfs":{"total":96636764160,"available":96591814656,"internally_reserved":0,"allocated":17276928,"data_stored":16993047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":216289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40352,"kb_used_data":13328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331488,"statfs":{"total":96636764160,"available":96595443712,"internally_reserved":0,"allocated":13647872,"data_stored":13373543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43872,"kb_used_data":16848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327968,"statfs":{"total":96636764160,"available":96591839232,"internally_reserved":0,"allocated":17252352,"data_stored":16977549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36272,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335568,"statfs":{"total":96636764160,"available":96599621632,"internally_reserved":0,"allocated":9465856,"data_stored":9186272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:42.070 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.223+0000 7f317ec00640 1 -- 172.21.15.100:0/4213337313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3178161140 msgr2=0x7f31780b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.223+0000 7f317ec00640 1 --2- 172.21.15.100:0/4213337313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3178161140 0x7f31780b21c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f316c009830 tx=0x7f316c02a530 comp rx=0 tx=0).stop 2024-09-10T21:07:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.223+0000 7f317ec00640 1 -- 172.21.15.100:0/4213337313 shutdown_connections 2024-09-10T21:07:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.223+0000 7f317ec00640 1 --2- 172.21.15.100:0/4213337313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3178161140 0x7f31780b21c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.223+0000 7f317ec00640 1 -- 172.21.15.100:0/4213337313 >> 172.21.15.100:0/4213337313 conn(0x7f31780d3ab0 msgr2=0x7f31780d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.223+0000 7f317ec00640 1 -- 172.21.15.100:0/4213337313 shutdown_connections 2024-09-10T21:07:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.223+0000 7f317ec00640 1 -- 172.21.15.100:0/4213337313 wait complete. 2024-09-10T21:07:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.225+0000 7f317ec00640 1 Processor -- start 2024-09-10T21:07:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.225+0000 7f317ec00640 1 -- start start 2024-09-10T21:07:42.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317ec00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f317806d060 0x7f31781f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317ec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f317806e0a0 0x7f3178157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317ec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3178161140 0x7f31780b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317ec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f31781616a0 con 0x7f3178161140 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317ec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3178161520 con 0x7f317806e0a0 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317ec00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f317806e770 con 0x7f317806d060 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3178161140 0x7f31780b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3178161140 0x7f31780b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41734/0 (socket says 172.21.15.100:41734) 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317e200640 1 -- 172.21.15.100:0/3423222113 learned_addr learned my addr 172.21.15.100:0/3423222113 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317ce00640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f317806e0a0 0x7f3178157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317d800640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f317806d060 0x7f31781f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317e200640 1 -- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f317806d060 msgr2=0x7f31781f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317e200640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f317806d060 0x7f31781f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317e200640 1 -- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f317806e0a0 msgr2=0x7f3178157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.226+0000 7f317e200640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f317806e0a0 0x7f3178157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.227+0000 7f317e200640 1 -- 172.21.15.100:0/3423222113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3178156220 con 0x7f3178161140 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.227+0000 7f317e200640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3178161140 0x7f31780b3240 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f317000cbc0 tx=0x7f317000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.227+0000 7f3175600640 1 -- 172.21.15.100:0/3423222113 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170016020 con 0x7f3178161140 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.227+0000 7f3175600640 1 -- 172.21.15.100:0/3423222113 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f317000ae30 con 0x7f3178161140 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.227+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31780b3db0 con 0x7f3178161140 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.227+0000 7f3175600640 1 -- 172.21.15.100:0/3423222113 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170012660 con 0x7f3178161140 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.227+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31781564c0 con 0x7f3178161140 2024-09-10T21:07:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.228+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31780b3030 con 0x7f3178161140 2024-09-10T21:07:42.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.229+0000 7f3175600640 1 -- 172.21.15.100:0/3423222113 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f31700128c0 con 0x7f3178161140 2024-09-10T21:07:42.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.230+0000 7f3175600640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3158077f70 0x7f315807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.230+0000 7f3175600640 1 -- 172.21.15.100:0/3423222113 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f317009a4d0 con 0x7f3178161140 2024-09-10T21:07:42.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.231+0000 7f317d800640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3158077f70 0x7f315807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.231+0000 7f317d800640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3158077f70 0x7f315807a430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f316c034000 tx=0x7f316c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:42.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.234+0000 7f3175600640 1 -- 172.21.15.100:0/3423222113 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3170020020 con 0x7f3178161140 2024-09-10T21:07:42.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.412+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31780b42d0 con 0x7f3158077f70 2024-09-10T21:07:42.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.413+0000 7f3175600640 1 -- 172.21.15.100:0/3423222113 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13421 (secure 0 0 0) 0x7f31780b42d0 con 0x7f3158077f70 2024-09-10T21:07:42.418 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:42.418 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.415+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3158077f70 msgr2=0x7f315807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.415+0000 7f317ec00640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3158077f70 0x7f315807a430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f316c034000 tx=0x7f316c004730 comp rx=0 tx=0).stop 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.415+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3178161140 msgr2=0x7f31780b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.415+0000 7f317ec00640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3178161140 0x7f31780b3240 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f317000cbc0 tx=0x7f317000a430 comp rx=0 tx=0).stop 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.415+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 shutdown_connections 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.415+0000 7f317ec00640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3178161140 0x7f31780b3240 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.416+0000 7f317ec00640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3158077f70 0x7f315807a430 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.416+0000 7f317ec00640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f317806e0a0 0x7f3178157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.416+0000 7f317ec00640 1 --2- 172.21.15.100:0/3423222113 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f317806d060 0x7f31781f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.416+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 >> 172.21.15.100:0/3423222113 conn(0x7f31780d3ab0 msgr2=0x7f31780b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.416+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 shutdown_connections 2024-09-10T21:07:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.416+0000 7f317ec00640 1 -- 172.21.15.100:0/3423222113 wait complete. 2024-09-10T21:07:42.436 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-09-10T21:07:40.711029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286644,"kb_used_data":70444,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754688076,"statfs":{"total":773094113280,"available":772800589824,"internally_reserved":0,"allocated":72134656,"data_stored":69930529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33570114,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-32800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001536"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T21:07:09.982211+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:09.982211+0000","last_peered":"2024-09-10T21:07:09.982211+0000","last_clean":"2024-09-10T21:07:09.982211+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:09.982211+0000","last_undegraded":"2024-09-10T21:07:09.982211+0000","last_fullsized":"2024-09-10T21:07:09.982211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35676,"kb_used_data":8652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336164,"statfs":{"total":96636764160,"available":96600231936,"internally_reserved":0,"allocated":8859648,"data_stored":8588919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":4556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":4665344,"data_stored":4394579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43896,"kb_used_data":16872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327944,"statfs":{"total":96636764160,"available":96591814656,"internally_reserved":0,"allocated":17276928,"data_stored":16993047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":216289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40352,"kb_used_data":13328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331488,"statfs":{"total":96636764160,"available":96595443712,"internally_reserved":0,"allocated":13647872,"data_stored":13373543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43872,"kb_used_data":16848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327968,"statfs":{"total":96636764160,"available":96591839232,"internally_reserved":0,"allocated":17252352,"data_stored":16977549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36272,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335568,"statfs":{"total":96636764160,"available":96599621632,"internally_reserved":0,"allocated":9465856,"data_stored":9186272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:42.437 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T21:07:42.437 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:42.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.589+0000 7fad47e00640 1 -- 172.21.15.100:0/2290332614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4015b590 msgr2=0x7fad400739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.589+0000 7fad47e00640 1 --2- 172.21.15.100:0/2290332614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4015b590 0x7fad400739c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad38005fd0 tx=0x7fad3802aa90 comp rx=0 tx=0).stop 2024-09-10T21:07:42.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.589+0000 7fad47e00640 1 -- 172.21.15.100:0/2290332614 shutdown_connections 2024-09-10T21:07:42.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.589+0000 7fad47e00640 1 --2- 172.21.15.100:0/2290332614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4015b590 0x7fad400739c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.589+0000 7fad47e00640 1 --2- 172.21.15.100:0/2290332614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad40154cf0 0x7fad4015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.589+0000 7fad47e00640 1 -- 172.21.15.100:0/2290332614 >> 172.21.15.100:0/2290332614 conn(0x7fad4006cb50 msgr2=0x7fad4006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:42.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.589+0000 7fad47e00640 1 -- 172.21.15.100:0/2290332614 shutdown_connections 2024-09-10T21:07:42.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.589+0000 7fad47e00640 1 -- 172.21.15.100:0/2290332614 wait complete. 2024-09-10T21:07:42.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.591+0000 7fad47e00640 1 Processor -- start 2024-09-10T21:07:42.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.591+0000 7fad47e00640 1 -- start start 2024-09-10T21:07:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad47e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad40073560 0x7fad4015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad47e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad40154cf0 0x7fad400cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad47e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4015b590 0x7fad401533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad47e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad4006fc40 con 0x7fad40073560 2024-09-10T21:07:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad47e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad4006fac0 con 0x7fad40154cf0 2024-09-10T21:07:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad47e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fad4006fdc0 con 0x7fad4015b590 2024-09-10T21:07:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad45400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad40073560 0x7fad4015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad45400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad40073560 0x7fad4015a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41738/0 (socket says 172.21.15.100:41738) 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.592+0000 7fad45400640 1 -- 172.21.15.100:0/909682941 learned_addr learned my addr 172.21.15.100:0/909682941 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad45400640 1 -- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4015b590 msgr2=0x7fad401533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad44a00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad40154cf0 0x7fad400cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad45e00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4015b590 0x7fad401533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad45400640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4015b590 0x7fad401533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad45400640 1 -- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad40154cf0 msgr2=0x7fad400cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad45400640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad40154cf0 0x7fad400cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad45400640 1 -- 172.21.15.100:0/909682941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad401f7d00 con 0x7fad40073560 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad44a00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad40154cf0 0x7fad400cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad45e00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4015b590 0x7fad401533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:42.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad45400640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad40073560 0x7fad4015a140 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fad3400ea20 tx=0x7fad3400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad3d600640 1 -- 172.21.15.100:0/909682941 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3400cd80 con 0x7fad40073560 2024-09-10T21:07:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad3d600640 1 -- 172.21.15.100:0/909682941 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad34010430 con 0x7fad40073560 2024-09-10T21:07:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad3d600640 1 -- 172.21.15.100:0/909682941 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34010840 con 0x7fad40073560 2024-09-10T21:07:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad401f7fe0 con 0x7fad40073560 2024-09-10T21:07:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.593+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad401f85a0 con 0x7fad40073560 2024-09-10T21:07:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.595+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad40070270 con 0x7fad40073560 2024-09-10T21:07:42.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.595+0000 7fad3d600640 1 -- 172.21.15.100:0/909682941 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fad340109e0 con 0x7fad40073560 2024-09-10T21:07:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.596+0000 7fad3d600640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fad20077f70 0x7fad2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.596+0000 7fad3d600640 1 -- 172.21.15.100:0/909682941 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fad3409a820 con 0x7fad40073560 2024-09-10T21:07:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.597+0000 7fad44a00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fad20077f70 0x7fad2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.597+0000 7fad44a00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fad20077f70 0x7fad2007a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad2c000f60 tx=0x7fad2c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:42.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.600+0000 7fad3d600640 1 -- 172.21.15.100:0/909682941 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fad340633f0 con 0x7fad40073560 2024-09-10T21:07:42.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.784+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad40154620 con 0x7fad20077f70 2024-09-10T21:07:42.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.785+0000 7fad3d600640 1 -- 172.21.15.100:0/909682941 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13490 (secure 0 0 0) 0x7fad40154620 con 0x7fad20077f70 2024-09-10T21:07:42.790 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:42.790 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:42.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.787+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fad20077f70 msgr2=0x7fad2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.787+0000 7fad47e00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fad20077f70 0x7fad2007a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad2c000f60 tx=0x7fad2c009040 comp rx=0 tx=0).stop 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.787+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad40073560 msgr2=0x7fad4015a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.787+0000 7fad47e00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad40073560 0x7fad4015a140 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fad3400ea20 tx=0x7fad3400eee0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.788+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 shutdown_connections 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.788+0000 7fad47e00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4015b590 0x7fad401533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.788+0000 7fad47e00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fad20077f70 0x7fad2007a430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.788+0000 7fad47e00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad40154cf0 0x7fad400cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.788+0000 7fad47e00640 1 --2- 172.21.15.100:0/909682941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad40073560 0x7fad4015a140 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.788+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 >> 172.21.15.100:0/909682941 conn(0x7fad4006cb50 msgr2=0x7fad400afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.788+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 shutdown_connections 2024-09-10T21:07:42.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.788+0000 7fad47e00640 1 -- 172.21.15.100:0/909682941 wait complete. 2024-09-10T21:07:42.808 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-10T21:07:42.711379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":229556,"kb_used_data":13324,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754745164,"statfs":{"total":773094113280,"available":772859047936,"internally_reserved":0,"allocated":13643776,"data_stored":11310102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33570696,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-9,"num_read_kb":-8192,"num_write":-73,"num_write_kb":-32804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.766482"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":153,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T21:07:38.965406+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:38.965406+0000","last_peered":"2024-09-10T21:07:38.965406+0000","last_clean":"2024-09-10T21:07:38.965406+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:38.965406+0000","last_undegraded":"2024-09-10T21:07:38.965406+0000","last_fullsized":"2024-09-10T21:07:38.965406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1105920,"data_stored":809434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36272,"kb_used_data":9244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335568,"statfs":{"total":96636764160,"available":96599621632,"internally_reserved":0,"allocated":9465856,"data_stored":9186272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:42.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:07:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.960+0000 7f9560e00640 1 -- 172.21.15.100:0/1897799920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c15c010 msgr2=0x7f955c0cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.960+0000 7f9560e00640 1 --2- 172.21.15.100:0/1897799920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c15c010 0x7f955c0cebe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9548009830 tx=0x7f954802a520 comp rx=0 tx=0).stop 2024-09-10T21:07:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.960+0000 7f9560e00640 1 -- 172.21.15.100:0/1897799920 shutdown_connections 2024-09-10T21:07:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.960+0000 7f9560e00640 1 --2- 172.21.15.100:0/1897799920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f955c0cf120 0x7f955c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.960+0000 7f9560e00640 1 --2- 172.21.15.100:0/1897799920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c15c010 0x7f955c0cebe0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.960+0000 7f9560e00640 1 -- 172.21.15.100:0/1897799920 >> 172.21.15.100:0/1897799920 conn(0x7f955c0cc7d0 msgr2=0x7f955c0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.960+0000 7f9560e00640 1 -- 172.21.15.100:0/1897799920 shutdown_connections 2024-09-10T21:07:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.960+0000 7f9560e00640 1 -- 172.21.15.100:0/1897799920 wait complete. 2024-09-10T21:07:42.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.961+0000 7f9560e00640 1 Processor -- start 2024-09-10T21:07:42.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.962+0000 7f9560e00640 1 -- start start 2024-09-10T21:07:42.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.962+0000 7f9560e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f955c0b3dc0 0x7f955c0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9560e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c0cf120 0x7f955c1f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9560e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f955c15c010 0x7f955c070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9560e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f955c15df30 con 0x7f955c0cf120 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9560e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f955c15ddb0 con 0x7f955c15c010 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9560e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f955c15e0b0 con 0x7f955c0b3dc0 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c0cf120 0x7f955c1f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f955c0b3dc0 0x7f955c0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c0cf120 0x7f955c1f4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41754/0 (socket says 172.21.15.100:41754) 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559400640 1 -- 172.21.15.100:0/457114205 learned_addr learned my addr 172.21.15.100:0/457114205 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f955a800640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f955c15c010 0x7f955c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559400640 1 -- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f955c0b3dc0 msgr2=0x7f955c0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559400640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f955c0b3dc0 0x7f955c0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559400640 1 -- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f955c15c010 msgr2=0x7f955c070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559400640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f955c15c010 0x7f955c070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:42.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.963+0000 7f9559400640 1 -- 172.21.15.100:0/457114205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c0707c0 con 0x7f955c0cf120 2024-09-10T21:07:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.964+0000 7f9559400640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c0cf120 0x7f955c1f4cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9548000c00 tx=0x7f9548033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.964+0000 7f9552000640 1 -- 172.21.15.100:0/457114205 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9548031d60 con 0x7f955c0cf120 2024-09-10T21:07:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.964+0000 7f9552000640 1 -- 172.21.15.100:0/457114205 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9548033070 con 0x7f955c0cf120 2024-09-10T21:07:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.964+0000 7f9552000640 1 -- 172.21.15.100:0/457114205 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95480334c0 con 0x7f955c0cf120 2024-09-10T21:07:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.964+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955c0c9230 con 0x7f955c0cf120 2024-09-10T21:07:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.964+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f955c0c97f0 con 0x7f955c0cf120 2024-09-10T21:07:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.965+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f955c15e640 con 0x7f955c0cf120 2024-09-10T21:07:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.966+0000 7f9552000640 1 -- 172.21.15.100:0/457114205 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f95480035f0 con 0x7f955c0cf120 2024-09-10T21:07:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.967+0000 7f9552000640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f953c077fa0 0x7f953c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:42.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.967+0000 7f9552000640 1 -- 172.21.15.100:0/457114205 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f95480baf40 con 0x7f955c0cf120 2024-09-10T21:07:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.968+0000 7f9559e00640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f953c077fa0 0x7f953c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.968+0000 7f9559e00640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f953c077fa0 0x7f953c07a460 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f954c0046b0 tx=0x7f954c007d40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:42.971+0000 7f9552000640 1 -- 172.21.15.100:0/457114205 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f954803f030 con 0x7f955c0cf120 2024-09-10T21:07:43.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.158+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f955c156490 con 0x7f955c0cf120 2024-09-10T21:07:43.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.159+0000 7f9552000640 1 -- 172.21.15.100:0/457114205 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+13329 (secure 0 0 0) 0x7f954808c2c0 con 0x7f955c0cf120 2024-09-10T21:07:43.164 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:43.164 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":44,"fsid":"65dcb08a-1e46-42c5-ba37-fc802a6ee031","created":"2024-09-10T21:05:41.552974+0000","modified":"2024-09-10T21:07:38.951160+0000","last_up_change":"2024-09-10T21:05:55.652610+0000","last_in_change":"2024-09-10T21:05:45.725025+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:05:56.711179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00e1ec36-cb79-42be-a075-cad84412e892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6801","nonce":2888312606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6803","nonce":2888312606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6807","nonce":2888312606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2888312606},{"type":"v1","addr":"172.21.15.100:6805","nonce":2888312606}]},"public_addr":"172.21.15.100:6801/2888312606","cluster_addr":"172.21.15.100:6803/2888312606","heartbeat_back_addr":"172.21.15.100:6807/2888312606","heartbeat_front_addr":"172.21.15.100:6805/2888312606","state":["exists","up"]},{"osd":1,"uuid":"01aa968c-b20a-4cd6-a555-7841ab33bc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6813","nonce":3537518613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6817","nonce":3537518613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6823","nonce":3537518613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":3537518613},{"type":"v1","addr":"172.21.15.100:6821","nonce":3537518613}]},"public_addr":"172.21.15.100:6813/3537518613","cluster_addr":"172.21.15.100:6817/3537518613","heartbeat_back_addr":"172.21.15.100:6823/3537518613","heartbeat_front_addr":"172.21.15.100:6821/3537518613","state":["exists","up"]},{"osd":2,"uuid":"dbf74690-bfe6-4315-a650-f5eab519ecc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6809","nonce":838833345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6812","nonce":838833345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6820","nonce":838833345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":838833345},{"type":"v1","addr":"172.21.15.100:6816","nonce":838833345}]},"public_addr":"172.21.15.100:6809/838833345","cluster_addr":"172.21.15.100:6812/838833345","heartbeat_back_addr":"172.21.15.100:6820/838833345","heartbeat_front_addr":"172.21.15.100:6816/838833345","state":["exists","up"]},{"osd":3,"uuid":"aed4b72b-deeb-4265-b909-bce1f98aad52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6825","nonce":392814175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6827","nonce":392814175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6831","nonce":392814175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":392814175},{"type":"v1","addr":"172.21.15.100:6829","nonce":392814175}]},"public_addr":"172.21.15.100:6825/392814175","cluster_addr":"172.21.15.100:6827/392814175","heartbeat_back_addr":"172.21.15.100:6831/392814175","heartbeat_front_addr":"172.21.15.100:6829/392814175","state":["exists","up"]},{"osd":4,"uuid":"bfa10ad1-a488-4ad6-a5e4-a5e46f5f222b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6819","nonce":2230230044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6821","nonce":2230230044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6825","nonce":2230230044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2230230044},{"type":"v1","addr":"172.21.15.130:6823","nonce":2230230044}]},"public_addr":"172.21.15.130:6819/2230230044","cluster_addr":"172.21.15.130:6821/2230230044","heartbeat_back_addr":"172.21.15.130:6825/2230230044","heartbeat_front_addr":"172.21.15.130:6823/2230230044","state":["exists","up"]},{"osd":5,"uuid":"8c273034-22af-40cc-bbf7-ea5dca477b60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6811","nonce":1954625163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6813","nonce":1954625163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6817","nonce":1954625163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":1954625163},{"type":"v1","addr":"172.21.15.130:6815","nonce":1954625163}]},"public_addr":"172.21.15.130:6811/1954625163","cluster_addr":"172.21.15.130:6813/1954625163","heartbeat_back_addr":"172.21.15.130:6817/1954625163","heartbeat_front_addr":"172.21.15.130:6815/1954625163","state":["exists","up"]},{"osd":6,"uuid":"8ee93189-eb68-47cd-9c2b-7a83255ad552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6827","nonce":819652068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6829","nonce":819652068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6833","nonce":819652068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":819652068},{"type":"v1","addr":"172.21.15.130:6831","nonce":819652068}]},"public_addr":"172.21.15.130:6827/819652068","cluster_addr":"172.21.15.130:6829/819652068","heartbeat_back_addr":"172.21.15.130:6833/819652068","heartbeat_front_addr":"172.21.15.130:6831/819652068","state":["exists","up"]},{"osd":7,"uuid":"5fbf7a20-02bb-4eb4-9c54-08b9ba055721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6803","nonce":351910519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6805","nonce":351910519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6809","nonce":351910519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":351910519},{"type":"v1","addr":"172.21.15.130:6807","nonce":351910519}]},"public_addr":"172.21.15.130:6803/351910519","cluster_addr":"172.21.15.130:6805/351910519","heartbeat_back_addr":"172.21.15.130:6809/351910519","heartbeat_front_addr":"172.21.15.130:6807/351910519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.997858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.543730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.980225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.199355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.407949+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:51.790274+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.351365+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:05:52.140633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:6836/772903553":"2024-09-11T21:07:35.941067+0000","172.21.15.130:6834/772903553":"2024-09-11T21:07:35.941067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:07:43.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f953c077fa0 msgr2=0x7f953c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f953c077fa0 0x7f953c07a460 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f954c0046b0 tx=0x7f954c007d40 comp rx=0 tx=0).stop 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c0cf120 msgr2=0x7f955c1f4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c0cf120 0x7f955c1f4cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9548000c00 tx=0x7f9548033d60 comp rx=0 tx=0).stop 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 shutdown_connections 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f953c077fa0 0x7f953c07a460 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f955c15c010 0x7f955c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f955c0cf120 0x7f955c1f4cb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 --2- 172.21.15.100:0/457114205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f955c0b3dc0 0x7f955c0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 >> 172.21.15.100:0/457114205 conn(0x7f955c0cc7d0 msgr2=0x7f955c0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 shutdown_connections 2024-09-10T21:07:43.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:43.161+0000 7f9560e00640 1 -- 172.21.15.100:0/457114205 wait complete. 2024-09-10T21:07:44.182 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T21:07:44.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T21:07:44.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.343+0000 7f99c1e00640 1 -- 172.21.15.100:0/1273832160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a00040b0 msgr2=0x7f99a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.343+0000 7f99c1e00640 1 --2- 172.21.15.100:0/1273832160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a00040b0 0x7f99a0004800 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f99a800baf0 tx=0x7f99a0005830 comp rx=0 tx=0).stop 2024-09-10T21:07:44.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.343+0000 7f99bb400640 1 -- 172.21.15.100:0/1273832160 reap_dead start 2024-09-10T21:07:44.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.343+0000 7f99c1e00640 1 -- 172.21.15.100:0/1273832160 shutdown_connections 2024-09-10T21:07:44.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.343+0000 7f99c1e00640 1 -- 172.21.15.100:0/1273832160 >> 172.21.15.100:0/1273832160 conn(0x7f99bc06cb50 msgr2=0x7f99bc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:44.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.343+0000 7f99c1e00640 1 -- 172.21.15.100:0/1273832160 shutdown_connections 2024-09-10T21:07:44.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.343+0000 7f99c1e00640 1 -- 172.21.15.100:0/1273832160 wait complete. 2024-09-10T21:07:44.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.345+0000 7f99c1e00640 1 Processor -- start 2024-09-10T21:07:44.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.345+0000 7f99c1e00640 1 -- start start 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99c1e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99a00040b0 0x7f99bc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99c1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99bc0abab0 0x7f99bc0aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99c1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99bc1f58f0 0x7f99bc158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99c1e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc15f970 con 0x7f99bc0abab0 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99c1e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc15f7f0 con 0x7f99bc1f58f0 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99c1e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f99bc0b2860 con 0x7f99a00040b0 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99ba000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99bc0abab0 0x7f99bc0aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99ba000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99bc0abab0 0x7f99bc0aa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41768/0 (socket says 172.21.15.100:41768) 2024-09-10T21:07:44.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.346+0000 7f99ba000640 1 -- 172.21.15.100:0/2888613078 learned_addr learned my addr 172.21.15.100:0/2888613078 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99bb400640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99bc1f58f0 0x7f99bc158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99baa00640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99a00040b0 0x7f99bc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99ba000640 1 -- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99a00040b0 msgr2=0x7f99bc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99ba000640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99a00040b0 0x7f99bc15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99ba000640 1 -- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99bc1f58f0 msgr2=0x7f99bc158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99ba000640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99bc1f58f0 0x7f99bc158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99ba000640 1 -- 172.21.15.100:0/2888613078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc0ac070 con 0x7f99bc0abab0 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99bb400640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99bc1f58f0 0x7f99bc158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99baa00640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99a00040b0 0x7f99bc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99ba000640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99bc0abab0 0x7f99bc0aa170 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f99a800baf0 tx=0x7f99a80326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8004230 con 0x7f99bc0abab0 2024-09-10T21:07:44.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99a8032890 con 0x7f99bc0abab0 2024-09-10T21:07:44.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80044e0 con 0x7f99bc0abab0 2024-09-10T21:07:44.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99bc0a9690 con 0x7f99bc0abab0 2024-09-10T21:07:44.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.347+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99bc0a9c50 con 0x7f99bc0abab0 2024-09-10T21:07:44.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.348+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99bc0cc260 con 0x7f99bc0abab0 2024-09-10T21:07:44.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.349+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f99a8032ce0 con 0x7f99bc0abab0 2024-09-10T21:07:44.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.350+0000 7f99b3400640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f999c077f70 0x7f999c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.350+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f99a80ba9f0 con 0x7f99bc0abab0 2024-09-10T21:07:44.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.351+0000 7f99b3400640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7f999c07e410 0x7f999c080850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.351+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 --> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f999c080f20 con 0x7f999c07e410 2024-09-10T21:07:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.351+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f99a80bf2a0 con 0x7f99bc0abab0 2024-09-10T21:07:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.351+0000 7f99baa00640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f999c077f70 0x7f999c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.351+0000 7f99bb400640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7f999c07e410 0x7f999c080850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.351+0000 7f99bb400640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7f999c07e410 0x7f999c080850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.352+0000 7f99baa00640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f999c077f70 0x7f999c07a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f99ac001220 tx=0x7f99ac0067a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:44.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.352+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 <== osd.0 v2:172.21.15.100:6800/2888312606 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f999c080f20 con 0x7f999c07e410 2024-09-10T21:07:44.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.365+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 --> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f99bc0b2df0 con 0x7f999c07e410 2024-09-10T21:07:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.365+0000 7f99b3400640 1 -- 172.21.15.100:0/2888613078 <== osd.0 v2:172.21.15.100:6800/2888312606 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f99bc0b2df0 con 0x7f999c07e410 2024-09-10T21:07:44.370 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:44.370 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T21:07:44.370 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7f999c07e410 msgr2=0x7f999c080850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.100:6800/2888312606,v1:172.21.15.100:6801/2888312606] conn(0x7f999c07e410 0x7f999c080850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f999c077f70 msgr2=0x7f999c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f999c077f70 0x7f999c07a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f99ac001220 tx=0x7f99ac0067a0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99bc0abab0 msgr2=0x7f99bc0aa170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 --2- 172.21.15.100:0/2888613078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99bc0abab0 0x7f99bc0aa170 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f99a800baf0 tx=0x7f99a80326a0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99bb400640 1 -- 172.21.15.100:0/2888613078 reap_dead start 2024-09-10T21:07:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 shutdown_connections 2024-09-10T21:07:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 >> 172.21.15.100:0/2888613078 conn(0x7f99bc06cb50 msgr2=0x7f99bc15bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 shutdown_connections 2024-09-10T21:07:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.366+0000 7f99c1e00640 1 -- 172.21.15.100:0/2888613078 wait complete. 2024-09-10T21:07:44.386 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T21:07:44.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.539+0000 7f4cbb200640 1 -- 172.21.15.100:0/4158776907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cbc15d580 msgr2=0x7f4cbc15da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.539+0000 7f4cbb200640 1 --2- 172.21.15.100:0/4158776907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cbc15d580 0x7f4cbc15da10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4005fd0 tx=0x7f4cb402a8b0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.539+0000 7f4cbb200640 1 -- 172.21.15.100:0/4158776907 shutdown_connections 2024-09-10T21:07:44.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.539+0000 7f4cbb200640 1 --2- 172.21.15.100:0/4158776907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cbc15d580 0x7f4cbc15da10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.539+0000 7f4cbb200640 1 --2- 172.21.15.100:0/4158776907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cbc150b70 0x7f4cbc0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.539+0000 7f4cbb200640 1 -- 172.21.15.100:0/4158776907 >> 172.21.15.100:0/4158776907 conn(0x7f4cbc0b1480 msgr2=0x7f4cbc0b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:44.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.539+0000 7f4cbb200640 1 -- 172.21.15.100:0/4158776907 shutdown_connections 2024-09-10T21:07:44.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.539+0000 7f4cbb200640 1 -- 172.21.15.100:0/4158776907 wait complete. 2024-09-10T21:07:44.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.541+0000 7f4cbb200640 1 Processor -- start 2024-09-10T21:07:44.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.541+0000 7f4cbb200640 1 -- start start 2024-09-10T21:07:44.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cbb200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cbc073f50 0x7f4cbc148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cbb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cbc150b70 0x7f4cbc155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cbb200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cbc15d580 0x7f4cbc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cbb200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0704e0 con 0x7f4cbc150b70 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cbb200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc070360 con 0x7f4cbc15d580 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cbb200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0b4140 con 0x7f4cbc073f50 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cb9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cbc150b70 0x7f4cbc155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cb9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cbc150b70 0x7f4cbc155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41784/0 (socket says 172.21.15.100:41784) 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cb9400640 1 -- 172.21.15.100:0/3567643760 learned_addr learned my addr 172.21.15.100:0/3567643760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cb9e00640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cbc073f50 0x7f4cbc148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.542+0000 7f4cba800640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cbc15d580 0x7f4cbc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb9400640 1 -- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cbc073f50 msgr2=0x7f4cbc148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb9400640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cbc073f50 0x7f4cbc148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb9400640 1 -- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cbc15d580 msgr2=0x7f4cbc155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb9400640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cbc15d580 0x7f4cbc155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb9400640 1 -- 172.21.15.100:0/3567643760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc1579b0 con 0x7f4cbc150b70 2024-09-10T21:07:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb9400640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cbc150b70 0x7f4cbc155640 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c480 tx=0x7f4ca800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb2000640 1 -- 172.21.15.100:0/3567643760 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8017070 con 0x7f4cbc150b70 2024-09-10T21:07:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb2000640 1 -- 172.21.15.100:0/3567643760 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ca80053c0 con 0x7f4cbc150b70 2024-09-10T21:07:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cb2000640 1 -- 172.21.15.100:0/3567643760 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8003850 con 0x7f4cbc150b70 2024-09-10T21:07:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc157c90 con 0x7f4cbc150b70 2024-09-10T21:07:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.543+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc158250 con 0x7f4cbc150b70 2024-09-10T21:07:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.545+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc0b31b0 con 0x7f4cbc150b70 2024-09-10T21:07:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.546+0000 7f4cb2000640 1 -- 172.21.15.100:0/3567643760 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4ca80039f0 con 0x7f4cbc150b70 2024-09-10T21:07:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.546+0000 7f4cb2000640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c9c077f70 0x7f4c9c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.547+0000 7f4cb2000640 1 -- 172.21.15.100:0/3567643760 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f4ca8099180 con 0x7f4cbc150b70 2024-09-10T21:07:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.547+0000 7f4cb9e00640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c9c077f70 0x7f4c9c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.548+0000 7f4cb9e00640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c9c077f70 0x7f4c9c07a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0aeac0 tx=0x7f4cac009260 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:44.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.551+0000 7f4cb2000640 1 -- 172.21.15.100:0/3567643760 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4ca80617a0 con 0x7f4cbc150b70 2024-09-10T21:07:44.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.735+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4cbc14dec0 con 0x7f4c9c077f70 2024-09-10T21:07:44.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.736+0000 7f4cb2000640 1 -- 172.21.15.100:0/3567643760 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4cbc14dec0 con 0x7f4c9c077f70 2024-09-10T21:07:44.740 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c9c077f70 msgr2=0x7f4c9c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c9c077f70 0x7f4c9c07a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0aeac0 tx=0x7f4cac009260 comp rx=0 tx=0).stop 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cbc150b70 msgr2=0x7f4cbc155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cbc150b70 0x7f4cbc155640 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c480 tx=0x7f4ca800c880 comp rx=0 tx=0).stop 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 shutdown_connections 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4c9c077f70 0x7f4c9c07a430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cbc15d580 0x7f4cbc155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cbc150b70 0x7f4cbc155640 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 --2- 172.21.15.100:0/3567643760 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cbc073f50 0x7f4cbc148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 >> 172.21.15.100:0/3567643760 conn(0x7f4cbc0b1480 msgr2=0x7f4cbc0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:44.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 shutdown_connections 2024-09-10T21:07:44.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.738+0000 7f4cbb200640 1 -- 172.21.15.100:0/3567643760 wait complete. 2024-09-10T21:07:44.758 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T21:07:44.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T21:07:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.915+0000 7fbee7e00640 1 -- 172.21.15.100:0/2933019037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 msgr2=0x7fbec8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.915+0000 7fbee7e00640 1 --2- 172.21.15.100:0/2933019037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 0x7fbec8003e00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c710 tx=0x7fbec8005830 comp rx=0 tx=0).stop 2024-09-10T21:07:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.915+0000 7fbee7e00640 1 -- 172.21.15.100:0/2933019037 shutdown_connections 2024-09-10T21:07:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.915+0000 7fbee7e00640 1 --2- 172.21.15.100:0/2933019037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 0x7fbec8003e00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.915+0000 7fbee7e00640 1 -- 172.21.15.100:0/2933019037 >> 172.21.15.100:0/2933019037 conn(0x7fbee00b1bf0 msgr2=0x7fbee00b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.915+0000 7fbee7e00640 1 -- 172.21.15.100:0/2933019037 shutdown_connections 2024-09-10T21:07:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.915+0000 7fbee7e00640 1 -- 172.21.15.100:0/2933019037 wait complete. 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.917+0000 7fbee7e00640 1 Processor -- start 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.917+0000 7fbee7e00640 1 -- start start 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 0x7fbee0159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee009dc40 0x7fbee0158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee7e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee01f4150 0x7fbee01f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee7e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbee00ad310 con 0x7fbec8003a00 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee7e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbee00ad190 con 0x7fbee009dc40 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee7e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbee0070470 con 0x7fbee01f4150 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 0x7fbee0159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 0x7fbee0159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41804/0 (socket says 172.21.15.100:41804) 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.918+0000 7fbee5400640 1 -- 172.21.15.100:0/2458638010 learned_addr learned my addr 172.21.15.100:0/2458638010 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee5e00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee01f4150 0x7fbee01f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee4a00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee009dc40 0x7fbee0158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee5400640 1 -- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee01f4150 msgr2=0x7fbee01f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee5400640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee01f4150 0x7fbee01f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee5400640 1 -- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee009dc40 msgr2=0x7fbee0158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee5400640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee009dc40 0x7fbee0158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee5400640 1 -- 172.21.15.100:0/2458638010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee0074540 con 0x7fbec8003a00 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee5400640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 0x7fbee0159590 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c630 tx=0x7fbed4006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4004830 con 0x7fbec8003a00 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbed4039070 con 0x7fbec8003a00 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee0074820 con 0x7fbec8003a00 2024-09-10T21:07:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.919+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4004d60 con 0x7fbec8003a00 2024-09-10T21:07:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.920+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee01f7830 con 0x7fbec8003a00 2024-09-10T21:07:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.920+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbee00709d0 con 0x7fbec8003a00 2024-09-10T21:07:44.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.922+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbed4033470 con 0x7fbec8003a00 2024-09-10T21:07:44.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.922+0000 7fbedd600640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbec0077f70 0x7fbec007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.923+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fbed40b96e0 con 0x7fbec8003a00 2024-09-10T21:07:44.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.923+0000 7fbedd600640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7fbec007e410 0x7fbec0080850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:44.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.923+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 --> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbed402cec0 con 0x7fbec007e410 2024-09-10T21:07:44.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.923+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbed40c0050 con 0x7fbec8003a00 2024-09-10T21:07:44.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.923+0000 7fbee4a00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbec0077f70 0x7fbec007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.923+0000 7fbee5e00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7fbec007e410 0x7fbec0080850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:44.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.924+0000 7fbee5e00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7fbec007e410 0x7fbec0080850 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:44.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.924+0000 7fbee4a00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbec0077f70 0x7fbec007a430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbecc001240 tx=0x7fbecc001110 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:44.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.924+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 <== osd.1 v2:172.21.15.100:6811/3537518613 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbed402cec0 con 0x7fbec007e410 2024-09-10T21:07:44.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.937+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 --> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbee01e8930 con 0x7fbec007e410 2024-09-10T21:07:44.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbedd600640 1 -- 172.21.15.100:0/2458638010 <== osd.1 v2:172.21.15.100:6811/3537518613 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbee01e8930 con 0x7fbec007e410 2024-09-10T21:07:44.942 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:44.943 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T21:07:44.943 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:44.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7fbec007e410 msgr2=0x7fbec0080850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.100:6811/3537518613,v1:172.21.15.100:6813/3537518613] conn(0x7fbec007e410 0x7fbec0080850 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbec0077f70 msgr2=0x7fbec007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbec0077f70 0x7fbec007a430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbecc001240 tx=0x7fbecc001110 comp rx=0 tx=0).stop 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 msgr2=0x7fbee0159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 --2- 172.21.15.100:0/2458638010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec8003a00 0x7fbee0159590 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c630 tx=0x7fbed4006380 comp rx=0 tx=0).stop 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee5e00640 1 -- 172.21.15.100:0/2458638010 reap_dead start 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 shutdown_connections 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 >> 172.21.15.100:0/2458638010 conn(0x7fbee00b1bf0 msgr2=0x7fbee00b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 shutdown_connections 2024-09-10T21:07:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:44.938+0000 7fbee7e00640 1 -- 172.21.15.100:0/2458638010 wait complete. 2024-09-10T21:07:44.958 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T21:07:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.110+0000 7fac4a600640 1 -- 172.21.15.100:0/529080345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 msgr2=0x7fac440cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.110+0000 7fac4a600640 1 --2- 172.21.15.100:0/529080345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 0x7fac440cf780 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fac3c005fd0 tx=0x7fac3c02a940 comp rx=0 tx=0).stop 2024-09-10T21:07:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.110+0000 7fac4a600640 1 -- 172.21.15.100:0/529080345 shutdown_connections 2024-09-10T21:07:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.110+0000 7fac4a600640 1 --2- 172.21.15.100:0/529080345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 0x7fac440cf780 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.110+0000 7fac4a600640 1 -- 172.21.15.100:0/529080345 >> 172.21.15.100:0/529080345 conn(0x7fac4406cb50 msgr2=0x7fac4406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.110+0000 7fac4a600640 1 -- 172.21.15.100:0/529080345 shutdown_connections 2024-09-10T21:07:45.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.110+0000 7fac4a600640 1 -- 172.21.15.100:0/529080345 wait complete. 2024-09-10T21:07:45.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.111+0000 7fac4a600640 1 Processor -- start 2024-09-10T21:07:45.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.112+0000 7fac4a600640 1 -- start start 2024-09-10T21:07:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.112+0000 7fac4a600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac440741e0 0x7fac44153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac4a600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4415b680 0x7fac440aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac4a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 0x7fac440aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac4a600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac440b2bf0 con 0x7fac4415c750 2024-09-10T21:07:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac4a600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac440b2a70 con 0x7fac440741e0 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac4a600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fac440b2d70 con 0x7fac4415b680 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 0x7fac440aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 0x7fac440aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41818/0 (socket says 172.21.15.100:41818) 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43e00640 1 -- 172.21.15.100:0/1241511794 learned_addr learned my addr 172.21.15.100:0/1241511794 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43400640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac440741e0 0x7fac44153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac3be00640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4415b680 0x7fac440aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43e00640 1 -- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4415b680 msgr2=0x7fac440aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43e00640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4415b680 0x7fac440aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43e00640 1 -- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac440741e0 msgr2=0x7fac44153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43e00640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac440741e0 0x7fac44153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43e00640 1 -- 172.21.15.100:0/1241511794 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac441f27e0 con 0x7fac4415c750 2024-09-10T21:07:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac3be00640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4415b680 0x7fac440aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.113+0000 7fac43400640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac440741e0 0x7fac44153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.114+0000 7fac43e00640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 0x7fac440aaef0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fac3c006010 tx=0x7fac3c031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.114+0000 7fac3b400640 1 -- 172.21.15.100:0/1241511794 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c03e070 con 0x7fac4415c750 2024-09-10T21:07:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.114+0000 7fac3b400640 1 -- 172.21.15.100:0/1241511794 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac3c004540 con 0x7fac4415c750 2024-09-10T21:07:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.114+0000 7fac3b400640 1 -- 172.21.15.100:0/1241511794 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c030430 con 0x7fac4415c750 2024-09-10T21:07:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.114+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac441f2ac0 con 0x7fac4415c750 2024-09-10T21:07:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.114+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac441f21b0 con 0x7fac4415c750 2024-09-10T21:07:45.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.115+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac440cc490 con 0x7fac4415c750 2024-09-10T21:07:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.116+0000 7fac3b400640 1 -- 172.21.15.100:0/1241511794 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fac3c02f070 con 0x7fac4415c750 2024-09-10T21:07:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.117+0000 7fac3b400640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac20077f70 0x7fac2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.117+0000 7fac3b400640 1 -- 172.21.15.100:0/1241511794 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fac3c0bb3d0 con 0x7fac4415c750 2024-09-10T21:07:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.118+0000 7fac43400640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac20077f70 0x7fac2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.118+0000 7fac43400640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac20077f70 0x7fac2007a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac440b1650 tx=0x7fac34009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.121+0000 7fac3b400640 1 -- 172.21.15.100:0/1241511794 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fac3c083fa0 con 0x7fac4415c750 2024-09-10T21:07:45.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.302+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fac4415bb00 con 0x7fac20077f70 2024-09-10T21:07:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.303+0000 7fac3b400640 1 -- 172.21.15.100:0/1241511794 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac4415bb00 con 0x7fac20077f70 2024-09-10T21:07:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T21:07:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac20077f70 msgr2=0x7fac2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac20077f70 0x7fac2007a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac440b1650 tx=0x7fac34009040 comp rx=0 tx=0).stop 2024-09-10T21:07:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 msgr2=0x7fac440aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 0x7fac440aaef0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fac3c006010 tx=0x7fac3c031e20 comp rx=0 tx=0).stop 2024-09-10T21:07:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 shutdown_connections 2024-09-10T21:07:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac4415c750 0x7fac440aaef0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4415b680 0x7fac440aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fac20077f70 0x7fac2007a430 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.305+0000 7fac4a600640 1 --2- 172.21.15.100:0/1241511794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac440741e0 0x7fac44153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.306+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 >> 172.21.15.100:0/1241511794 conn(0x7fac4406cb50 msgr2=0x7fac440b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.306+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 shutdown_connections 2024-09-10T21:07:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.306+0000 7fac4a600640 1 -- 172.21.15.100:0/1241511794 wait complete. 2024-09-10T21:07:45.326 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T21:07:45.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T21:07:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.484+0000 7fbb52c00640 1 -- 172.21.15.100:0/1887987963 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb4c15b680 msgr2=0x7fbb4c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.484+0000 7fbb52c00640 1 --2- 172.21.15.100:0/1887987963 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb4c15b680 0x7fbb4c15ba60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c005fd0 tx=0x7fbb3c02a8b0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.484+0000 7fbb52c00640 1 -- 172.21.15.100:0/1887987963 shutdown_connections 2024-09-10T21:07:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.484+0000 7fbb52c00640 1 --2- 172.21.15.100:0/1887987963 >> v2:172.21.15.130:3300/0 conn(0x7fbb4c15c750 0x7fbb4c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.484+0000 7fbb52c00640 1 --2- 172.21.15.100:0/1887987963 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb4c15b680 0x7fbb4c15ba60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.484+0000 7fbb52c00640 1 -- 172.21.15.100:0/1887987963 >> 172.21.15.100:0/1887987963 conn(0x7fbb4c06cb50 msgr2=0x7fbb4c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.484+0000 7fbb52c00640 1 -- 172.21.15.100:0/1887987963 shutdown_connections 2024-09-10T21:07:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.484+0000 7fbb52c00640 1 -- 172.21.15.100:0/1887987963 wait complete. 2024-09-10T21:07:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.486+0000 7fbb52c00640 1 Processor -- start 2024-09-10T21:07:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.486+0000 7fbb52c00640 1 -- start start 2024-09-10T21:07:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb52c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb4c0741e0 0x7fbb4c0aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb52c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c15b680 0x7fbb4c1f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb52c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb4c15c750 0x7fbb4c1f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb52c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0b2860 con 0x7fbb4c15b680 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb52c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0b29e0 con 0x7fbb4c15c750 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb52c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c0b2b60 con 0x7fbb4c0741e0 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb43400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c15b680 0x7fbb4c1f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb43400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c15b680 0x7fbb4c1f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41830/0 (socket says 172.21.15.100:41830) 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb43400640 1 -- 172.21.15.100:0/3375304906 learned_addr learned my addr 172.21.15.100:0/3375304906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb4be00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb4c0741e0 0x7fbb4c0aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.487+0000 7fbb50c00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb4c15c750 0x7fbb4c1f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb43400640 1 -- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb4c0741e0 msgr2=0x7fbb4c0aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb43400640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb4c0741e0 0x7fbb4c0aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb43400640 1 -- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb4c15c750 msgr2=0x7fbb4c1f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb43400640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb4c15c750 0x7fbb4c1f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb43400640 1 -- 172.21.15.100:0/3375304906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c0af280 con 0x7fbb4c15b680 2024-09-10T21:07:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb43400640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c15b680 0x7fbb4c1f5d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c500 tx=0x7fbb3400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34017070 con 0x7fbb4c15b680 2024-09-10T21:07:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb340035f0 con 0x7fbb4c15b680 2024-09-10T21:07:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34003a40 con 0x7fbb4c15b680 2024-09-10T21:07:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c158530 con 0x7fbb4c15b680 2024-09-10T21:07:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.488+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c158af0 con 0x7fbb4c15b680 2024-09-10T21:07:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.489+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb4c0ccd60 con 0x7fbb4c15b680 2024-09-10T21:07:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.491+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbb34003be0 con 0x7fbb4c15b680 2024-09-10T21:07:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.491+0000 7fbb48c00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbb28077f70 0x7fbb2807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.492+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fbb34099320 con 0x7fbb4c15b680 2024-09-10T21:07:45.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.492+0000 7fbb48c00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7fbb2807e410 0x7fbb28080850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.492+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 --> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb28080f20 con 0x7fbb2807e410 2024-09-10T21:07:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.492+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbb340a0050 con 0x7fbb4c15b680 2024-09-10T21:07:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.492+0000 7fbb4be00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbb28077f70 0x7fbb2807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.492+0000 7fbb50c00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7fbb2807e410 0x7fbb28080850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.493+0000 7fbb50c00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7fbb2807e410 0x7fbb28080850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.493+0000 7fbb4be00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbb28077f70 0x7fbb2807a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c034000 tx=0x7fbb3c004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.493+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 <== osd.2 v2:172.21.15.100:6808/838833345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb28080f20 con 0x7fbb2807e410 2024-09-10T21:07:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.506+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 --> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb4c154270 con 0x7fbb2807e410 2024-09-10T21:07:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb48c00640 1 -- 172.21.15.100:0/3375304906 <== osd.2 v2:172.21.15.100:6808/838833345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb4c154270 con 0x7fbb2807e410 2024-09-10T21:07:45.511 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:45.511 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T21:07:45.512 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7fbb2807e410 msgr2=0x7fbb28080850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.100:6808/838833345,v1:172.21.15.100:6809/838833345] conn(0x7fbb2807e410 0x7fbb28080850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbb28077f70 msgr2=0x7fbb2807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fbb28077f70 0x7fbb2807a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c034000 tx=0x7fbb3c004ab0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c15b680 msgr2=0x7fbb4c1f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 --2- 172.21.15.100:0/3375304906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c15b680 0x7fbb4c1f5d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c500 tx=0x7fbb3400c9c0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb50c00640 1 -- 172.21.15.100:0/3375304906 reap_dead start 2024-09-10T21:07:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 shutdown_connections 2024-09-10T21:07:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 >> 172.21.15.100:0/3375304906 conn(0x7fbb4c06cb50 msgr2=0x7fbb4c15d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 shutdown_connections 2024-09-10T21:07:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.507+0000 7fbb52c00640 1 -- 172.21.15.100:0/3375304906 wait complete. 2024-09-10T21:07:45.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T21:07:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.681+0000 7f4dda600640 1 -- 172.21.15.100:0/1506267406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd40cf810 msgr2=0x7f4dd4161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.681+0000 7f4dda600640 1 --2- 172.21.15.100:0/1506267406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd40cf810 0x7f4dd4161640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc005fd0 tx=0x7f4dbc02a6c0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.681+0000 7f4dda600640 1 -- 172.21.15.100:0/1506267406 shutdown_connections 2024-09-10T21:07:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.681+0000 7f4dda600640 1 --2- 172.21.15.100:0/1506267406 >> v2:172.21.15.130:3300/0 conn(0x7f4dd406eb60 0x7f4dd406efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.681+0000 7f4dda600640 1 --2- 172.21.15.100:0/1506267406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd40cf810 0x7f4dd4161640 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.681+0000 7f4dda600640 1 -- 172.21.15.100:0/1506267406 >> 172.21.15.100:0/1506267406 conn(0x7f4dd406cb50 msgr2=0x7f4dd406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.681+0000 7f4dda600640 1 -- 172.21.15.100:0/1506267406 shutdown_connections 2024-09-10T21:07:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.681+0000 7f4dda600640 1 -- 172.21.15.100:0/1506267406 wait complete. 2024-09-10T21:07:45.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.682+0000 7f4dda600640 1 Processor -- start 2024-09-10T21:07:45.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.683+0000 7f4dda600640 1 -- start start 2024-09-10T21:07:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.683+0000 7f4dda600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dd406eb60 0x7f4dd41f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.683+0000 7f4dda600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dd40cf810 0x7f4dd41542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.683+0000 7f4dda600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd415b4d0 0x7f4dd4155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.683+0000 7f4dda600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd40b2da0 con 0x7f4dd415b4d0 2024-09-10T21:07:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.683+0000 7f4dda600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd40b2c20 con 0x7f4dd406eb60 2024-09-10T21:07:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.683+0000 7f4dda600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd40b2f20 con 0x7f4dd40cf810 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd415b4d0 0x7f4dd4155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd415b4d0 0x7f4dd4155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41846/0 (socket says 172.21.15.100:41846) 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 -- 172.21.15.100:0/1359528542 learned_addr learned my addr 172.21.15.100:0/1359528542 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dcbe00640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dd40cf810 0x7f4dd41542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3400640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dd406eb60 0x7f4dd41f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 -- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dd40cf810 msgr2=0x7f4dd41542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dd40cf810 0x7f4dd41542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 -- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dd406eb60 msgr2=0x7f4dd41f93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dd406eb60 0x7f4dd41f93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 -- 172.21.15.100:0/1359528542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd4154eb0 con 0x7f4dd415b4d0 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.684+0000 7f4dd3e00640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd415b4d0 0x7f4dd4155560 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00ead0 tx=0x7f4dcc00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.685+0000 7f4dcb400640 1 -- 172.21.15.100:0/1359528542 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00cde0 con 0x7f4dd415b4d0 2024-09-10T21:07:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.685+0000 7f4dcb400640 1 -- 172.21.15.100:0/1359528542 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dcc004c10 con 0x7f4dd415b4d0 2024-09-10T21:07:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.685+0000 7f4dcb400640 1 -- 172.21.15.100:0/1359528542 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc005020 con 0x7f4dd415b4d0 2024-09-10T21:07:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.685+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd41f8900 con 0x7f4dd415b4d0 2024-09-10T21:07:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.685+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd4154ba0 con 0x7f4dd415b4d0 2024-09-10T21:07:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.686+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd40ae6e0 con 0x7f4dd415b4d0 2024-09-10T21:07:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.687+0000 7f4dcb400640 1 -- 172.21.15.100:0/1359528542 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4dcc00f040 con 0x7f4dd415b4d0 2024-09-10T21:07:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.688+0000 7f4dcb400640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4db0077f70 0x7f4db007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.688+0000 7f4dcb400640 1 -- 172.21.15.100:0/1359528542 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f4dcc09a2e0 con 0x7f4dd415b4d0 2024-09-10T21:07:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.688+0000 7f4dd3400640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4db0077f70 0x7f4db007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.689+0000 7f4dd3400640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4db0077f70 0x7f4db007a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40015e0 tx=0x7f4dc4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.692+0000 7f4dcb400640 1 -- 172.21.15.100:0/1359528542 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4dd40ae6e0 con 0x7f4dd415b4d0 2024-09-10T21:07:45.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.876+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4dd40b33d0 con 0x7f4db0077f70 2024-09-10T21:07:45.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.877+0000 7f4dcb400640 1 -- 172.21.15.100:0/1359528542 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4dd40b33d0 con 0x7f4db0077f70 2024-09-10T21:07:45.881 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T21:07:45.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4db0077f70 msgr2=0x7f4db007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4db0077f70 0x7f4db007a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40015e0 tx=0x7f4dc4009040 comp rx=0 tx=0).stop 2024-09-10T21:07:45.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd415b4d0 msgr2=0x7f4dd4155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd415b4d0 0x7f4dd4155560 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00ead0 tx=0x7f4dcc00ef90 comp rx=0 tx=0).stop 2024-09-10T21:07:45.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 shutdown_connections 2024-09-10T21:07:45.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd415b4d0 0x7f4dd4155560 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dd40cf810 0x7f4dd41542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f4db0077f70 0x7f4db007a430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 --2- 172.21.15.100:0/1359528542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dd406eb60 0x7f4dd41f93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 >> 172.21.15.100:0/1359528542 conn(0x7f4dd406cb50 msgr2=0x7f4dd40730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:45.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 shutdown_connections 2024-09-10T21:07:45.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:45.879+0000 7f4dda600640 1 -- 172.21.15.100:0/1359528542 wait complete. 2024-09-10T21:07:45.900 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T21:07:45.900 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T21:07:46.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.057+0000 7f73a3000640 1 -- 172.21.15.100:0/2092107113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c161140 msgr2=0x7f739c0b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.057+0000 7f73a3000640 1 --2- 172.21.15.100:0/2092107113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c161140 0x7f739c0b21c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f739c06cfa0 tx=0x7f739002a4b0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.057+0000 7f73a3000640 1 -- 172.21.15.100:0/2092107113 shutdown_connections 2024-09-10T21:07:46.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.057+0000 7f73a3000640 1 --2- 172.21.15.100:0/2092107113 >> v2:172.21.15.130:3300/0 conn(0x7f739c06e0a0 0x7f739c0d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.057+0000 7f73a3000640 1 --2- 172.21.15.100:0/2092107113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c161140 0x7f739c0b21c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.057+0000 7f73a3000640 1 -- 172.21.15.100:0/2092107113 >> 172.21.15.100:0/2092107113 conn(0x7f739c0d3ab0 msgr2=0x7f739c0d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:46.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.057+0000 7f73a3000640 1 -- 172.21.15.100:0/2092107113 shutdown_connections 2024-09-10T21:07:46.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.057+0000 7f73a3000640 1 -- 172.21.15.100:0/2092107113 wait complete. 2024-09-10T21:07:46.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.058+0000 7f73a3000640 1 Processor -- start 2024-09-10T21:07:46.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.059+0000 7f73a3000640 1 -- start start 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.059+0000 7f73a3000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c06e0a0 0x7f739c1f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.059+0000 7f73a3000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f739c161140 0x7f739c156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.059+0000 7f73a3000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f739c0cd850 0x7f739c0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.059+0000 7f73a3000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f739c06e770 con 0x7f739c06e0a0 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.059+0000 7f73a3000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f739c161730 con 0x7f739c0cd850 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.059+0000 7f73a3000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f739c06e8f0 con 0x7f739c161140 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c06e0a0 0x7f739c1f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c06e0a0 0x7f739c1f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41866/0 (socket says 172.21.15.100:41866) 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 -- 172.21.15.100:0/1350407658 learned_addr learned my addr 172.21.15.100:0/1350407658 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1200640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f739c161140 0x7f739c156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a2600640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f739c0cd850 0x7f739c0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 -- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f739c161140 msgr2=0x7f739c156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f739c161140 0x7f739c156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 -- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f739c0cd850 msgr2=0x7f739c0b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f739c0cd850 0x7f739c0b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 -- 172.21.15.100:0/1350407658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739c0cc750 con 0x7f739c06e0a0 2024-09-10T21:07:46.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a2600640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f739c0cd850 0x7f739c0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:46.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.060+0000 7f73a1c00640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c06e0a0 0x7f739c1f4d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7390009920 tx=0x7f7390033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.061+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390031d60 con 0x7f739c06e0a0 2024-09-10T21:07:46.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.061+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7390005020 con 0x7f739c06e0a0 2024-09-10T21:07:46.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.061+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390005470 con 0x7f739c06e0a0 2024-09-10T21:07:46.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.061+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739c0ccd70 con 0x7f739c06e0a0 2024-09-10T21:07:46.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.061+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f739c0cd330 con 0x7f739c06e0a0 2024-09-10T21:07:46.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.062+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f739c0694d0 con 0x7f739c06e0a0 2024-09-10T21:07:46.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.063+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f73900047a0 con 0x7f739c06e0a0 2024-09-10T21:07:46.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.064+0000 7f7399600640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f737c077fa0 0x7f737c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.064+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f73900bad00 con 0x7f739c06e0a0 2024-09-10T21:07:46.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.064+0000 7f7399600640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7f737c07e440 0x7f737c080880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.064+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 --> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73900317a0 con 0x7f737c07e440 2024-09-10T21:07:46.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.064+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f73900bd320 con 0x7f739c06e0a0 2024-09-10T21:07:46.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.064+0000 7f73a1200640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f737c077fa0 0x7f737c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.064+0000 7f73a2600640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7f737c07e440 0x7f737c080880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.065+0000 7f73a2600640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7f737c07e440 0x7f737c080880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.065+0000 7f73a1200640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f737c077fa0 0x7f737c07a460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7388005e10 tx=0x7f7388005da0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.066+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 <== osd.3 v2:172.21.15.100:6824/392814175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73900317a0 con 0x7f737c07e440 2024-09-10T21:07:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.079+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 --> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f739c0d1ae0 con 0x7f737c07e440 2024-09-10T21:07:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.079+0000 7f7399600640 1 -- 172.21.15.100:0/1350407658 <== osd.3 v2:172.21.15.100:6824/392814175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f739c0d1ae0 con 0x7f737c07e440 2024-09-10T21:07:46.084 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:46.084 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T21:07:46.084 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.079+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7f737c07e440 msgr2=0x7f737c080880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.079+0000 7f73a3000640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.100:6824/392814175,v1:172.21.15.100:6825/392814175] conn(0x7f737c07e440 0x7f737c080880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.079+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f737c077fa0 msgr2=0x7f737c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.079+0000 7f73a3000640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f737c077fa0 0x7f737c07a460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7388005e10 tx=0x7f7388005da0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.080+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c06e0a0 msgr2=0x7f739c1f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.080+0000 7f73a3000640 1 --2- 172.21.15.100:0/1350407658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f739c06e0a0 0x7f739c1f4d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7390009920 tx=0x7f7390033d60 comp rx=0 tx=0).stop 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.080+0000 7f73a2600640 1 -- 172.21.15.100:0/1350407658 reap_dead start 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.080+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 shutdown_connections 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.080+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 >> 172.21.15.100:0/1350407658 conn(0x7f739c0d3ab0 msgr2=0x7f739c0d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.080+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 shutdown_connections 2024-09-10T21:07:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.080+0000 7f73a3000640 1 -- 172.21.15.100:0/1350407658 wait complete. 2024-09-10T21:07:46.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T21:07:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.252+0000 7f074ac00640 1 -- 172.21.15.100:0/890133811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07440cf810 msgr2=0x7f0744161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.252+0000 7f074ac00640 1 --2- 172.21.15.100:0/890133811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07440cf810 0x7f0744161640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f072c009830 tx=0x7f072c02a5a0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.252+0000 7f074ac00640 1 -- 172.21.15.100:0/890133811 shutdown_connections 2024-09-10T21:07:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.252+0000 7f074ac00640 1 --2- 172.21.15.100:0/890133811 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f074406eb60 0x7f074406efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.252+0000 7f074ac00640 1 --2- 172.21.15.100:0/890133811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07440cf810 0x7f0744161640 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.252+0000 7f074ac00640 1 -- 172.21.15.100:0/890133811 >> 172.21.15.100:0/890133811 conn(0x7f074406cb50 msgr2=0x7f074406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.252+0000 7f074ac00640 1 -- 172.21.15.100:0/890133811 shutdown_connections 2024-09-10T21:07:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.252+0000 7f074ac00640 1 -- 172.21.15.100:0/890133811 wait complete. 2024-09-10T21:07:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.254+0000 7f074ac00640 1 Processor -- start 2024-09-10T21:07:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.254+0000 7f074ac00640 1 -- start start 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f074ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074406eb60 0x7f07441f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f074ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07440cf810 0x7f07440b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f074ac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f074415b4d0 0x7f07440ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f074ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f07440b2de0 con 0x7f074406eb60 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f074ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f07440b2c60 con 0x7f07440cf810 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f074ac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f07440b2f60 con 0x7f074415b4d0 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f0743e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074406eb60 0x7f07441f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f0743e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074406eb60 0x7f07441f87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41888/0 (socket says 172.21.15.100:41888) 2024-09-10T21:07:46.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f0743e00640 1 -- 172.21.15.100:0/3272154939 learned_addr learned my addr 172.21.15.100:0/3272154939 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f0748c00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f074415b4d0 0x7f07440ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.255+0000 7f0743400640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07440cf810 0x7f07440b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f0743e00640 1 -- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f074415b4d0 msgr2=0x7f07440ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f0743e00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f074415b4d0 0x7f07440ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f0743e00640 1 -- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07440cf810 msgr2=0x7f07440b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f0743e00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07440cf810 0x7f07440b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f0743e00640 1 -- 172.21.15.100:0/3272154939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07441f8cf0 con 0x7f074406eb60 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f0743e00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074406eb60 0x7f07441f87b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f073400cbc0 tx=0x7f073400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f073be00640 1 -- 172.21.15.100:0/3272154939 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734016020 con 0x7f074406eb60 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f073be00640 1 -- 172.21.15.100:0/3272154939 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f073400ad90 con 0x7f074406eb60 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07440afb30 con 0x7f074406eb60 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f073be00640 1 -- 172.21.15.100:0/3272154939 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734012680 con 0x7f074406eb60 2024-09-10T21:07:46.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.256+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07440b00f0 con 0x7f074406eb60 2024-09-10T21:07:46.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.257+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0744070000 con 0x7f074406eb60 2024-09-10T21:07:46.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.258+0000 7f073be00640 1 -- 172.21.15.100:0/3272154939 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f073401b400 con 0x7f074406eb60 2024-09-10T21:07:46.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.260+0000 7f073be00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0720077f70 0x7f072007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.260+0000 7f073be00640 1 -- 172.21.15.100:0/3272154939 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f073409a5c0 con 0x7f074406eb60 2024-09-10T21:07:46.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.260+0000 7f0743400640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0720077f70 0x7f072007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.261+0000 7f0743400640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0720077f70 0x7f072007a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f072c034000 tx=0x7f072c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.264+0000 7f073be00640 1 -- 172.21.15.100:0/3272154939 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0744070000 con 0x7f074406eb60 2024-09-10T21:07:46.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.449+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f074406ad60 con 0x7f0720077f70 2024-09-10T21:07:46.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.450+0000 7f073be00640 1 -- 172.21.15.100:0/3272154939 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f074406ad60 con 0x7f0720077f70 2024-09-10T21:07:46.454 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T21:07:46.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.452+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0720077f70 msgr2=0x7f072007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.452+0000 7f074ac00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0720077f70 0x7f072007a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f072c034000 tx=0x7f072c004730 comp rx=0 tx=0).stop 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.452+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074406eb60 msgr2=0x7f07441f87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.452+0000 7f074ac00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074406eb60 0x7f07441f87b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f073400cbc0 tx=0x7f073400a060 comp rx=0 tx=0).stop 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.452+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 shutdown_connections 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.453+0000 7f074ac00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f074415b4d0 0x7f07440ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.453+0000 7f074ac00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0720077f70 0x7f072007a430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.453+0000 7f074ac00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07440cf810 0x7f07440b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.453+0000 7f074ac00640 1 --2- 172.21.15.100:0/3272154939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074406eb60 0x7f07441f87b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.453+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 >> 172.21.15.100:0/3272154939 conn(0x7f074406cb50 msgr2=0x7f0744160d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.453+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 shutdown_connections 2024-09-10T21:07:46.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.453+0000 7f074ac00640 1 -- 172.21.15.100:0/3272154939 wait complete. 2024-09-10T21:07:46.472 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T21:07:46.473 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T21:07:46.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.629+0000 7fe735c00640 1 -- 172.21.15.100:0/3458812423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe714003fd0 msgr2=0x7fe714004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.629+0000 7fe735c00640 1 --2- 172.21.15.100:0/3458812423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe714003fd0 0x7fe714004800 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009b80 tx=0x7fe714005830 comp rx=0 tx=0).stop 2024-09-10T21:07:46.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.629+0000 7fe72f400640 1 -- 172.21.15.100:0/3458812423 reap_dead start 2024-09-10T21:07:46.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.629+0000 7fe735c00640 1 -- 172.21.15.100:0/3458812423 shutdown_connections 2024-09-10T21:07:46.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.629+0000 7fe735c00640 1 -- 172.21.15.100:0/3458812423 >> 172.21.15.100:0/3458812423 conn(0x7fe73006cb50 msgr2=0x7fe73006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:46.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.629+0000 7fe735c00640 1 -- 172.21.15.100:0/3458812423 shutdown_connections 2024-09-10T21:07:46.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.629+0000 7fe735c00640 1 -- 172.21.15.100:0/3458812423 wait complete. 2024-09-10T21:07:46.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.631+0000 7fe735c00640 1 Processor -- start 2024-09-10T21:07:46.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.631+0000 7fe735c00640 1 -- start start 2024-09-10T21:07:46.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe735c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe714003fd0 0x7fe7301f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe735c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7301545f0 0x7fe7301f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe735c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7301f2930 0x7fe7300b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe735c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe7300cfd30 con 0x7fe714003fd0 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe735c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe7300cfbb0 con 0x7fe7301f2930 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe735c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe7300cfeb0 con 0x7fe7301545f0 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe72ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe714003fd0 0x7fe7301f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe72ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe714003fd0 0x7fe7301f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41910/0 (socket says 172.21.15.100:41910) 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.632+0000 7fe72ea00640 1 -- 172.21.15.100:0/1534643460 learned_addr learned my addr 172.21.15.100:0/1534643460 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe72ea00640 1 -- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7301545f0 msgr2=0x7fe7301f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe72ea00640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7301545f0 0x7fe7301f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe72ea00640 1 -- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7301f2930 msgr2=0x7fe7300b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe72ea00640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7301f2930 0x7fe7300b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe72ea00640 1 -- 172.21.15.100:0/1534643460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7301f2e40 con 0x7fe714003fd0 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe72ea00640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe714003fd0 0x7fe7301f6410 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe72000e730 tx=0x7fe72000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720015020 con 0x7fe714003fd0 2024-09-10T21:07:46.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe72000c760 con 0x7fe714003fd0 2024-09-10T21:07:46.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7301f3120 con 0x7fe714003fd0 2024-09-10T21:07:46.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72000cb90 con 0x7fe714003fd0 2024-09-10T21:07:46.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.633+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe730154a70 con 0x7fe714003fd0 2024-09-10T21:07:46.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.634+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe73015f210 con 0x7fe714003fd0 2024-09-10T21:07:46.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.635+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe7200035f0 con 0x7fe714003fd0 2024-09-10T21:07:46.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.636+0000 7fe726a00640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe710077fa0 0x7fe71007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.636+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fe72009a640 con 0x7fe714003fd0 2024-09-10T21:07:46.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.636+0000 7fe726a00640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7fe71007e440 0x7fe710080880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.636+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 --> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe720018ec0 con 0x7fe71007e440 2024-09-10T21:07:46.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.636+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe7200a1050 con 0x7fe714003fd0 2024-09-10T21:07:46.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.637+0000 7fe72e000640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe710077fa0 0x7fe71007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.637+0000 7fe72f400640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7fe71007e440 0x7fe710080880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.638+0000 7fe72f400640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7fe71007e440 0x7fe710080880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.638+0000 7fe72e000640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe710077fa0 0x7fe71007a460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe71c035000 tx=0x7fe71c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.639+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 <== osd.4 v2:172.21.15.130:6818/2230230044 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe720018ec0 con 0x7fe71007e440 2024-09-10T21:07:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.652+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 --> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe73015f4d0 con 0x7fe71007e440 2024-09-10T21:07:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.652+0000 7fe726a00640 1 -- 172.21.15.100:0/1534643460 <== osd.4 v2:172.21.15.130:6818/2230230044 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe73015f4d0 con 0x7fe71007e440 2024-09-10T21:07:46.657 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:46.657 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T21:07:46.657 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.652+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7fe71007e440 msgr2=0x7fe710080880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.652+0000 7fe735c00640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6818/2230230044,v1:172.21.15.130:6819/2230230044] conn(0x7fe71007e440 0x7fe710080880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe710077fa0 msgr2=0x7fe71007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe735c00640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fe710077fa0 0x7fe71007a460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe71c035000 tx=0x7fe71c004730 comp rx=0 tx=0).stop 2024-09-10T21:07:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe714003fd0 msgr2=0x7fe7301f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe735c00640 1 --2- 172.21.15.100:0/1534643460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe714003fd0 0x7fe7301f6410 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe72000e730 tx=0x7fe72000ebf0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe72f400640 1 -- 172.21.15.100:0/1534643460 reap_dead start 2024-09-10T21:07:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 shutdown_connections 2024-09-10T21:07:46.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 >> 172.21.15.100:0/1534643460 conn(0x7fe73006cb50 msgr2=0x7fe7300cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:46.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 shutdown_connections 2024-09-10T21:07:46.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.653+0000 7fe735c00640 1 -- 172.21.15.100:0/1534643460 wait complete. 2024-09-10T21:07:46.671 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T21:07:46.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.824+0000 7ff71e600640 1 -- 172.21.15.100:0/4046997144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d24d0 msgr2=0x7ff7180d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.824+0000 7ff71e600640 1 --2- 172.21.15.100:0/4046997144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d24d0 0x7ff7180d01f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff7180b6630 tx=0x7ff70002a5f0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.825+0000 7ff71e600640 1 -- 172.21.15.100:0/4046997144 shutdown_connections 2024-09-10T21:07:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.825+0000 7ff71e600640 1 --2- 172.21.15.100:0/4046997144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d24d0 0x7ff7180d01f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.825+0000 7ff71e600640 1 --2- 172.21.15.100:0/4046997144 >> v2:172.21.15.130:3300/0 conn(0x7ff71815db30 0x7ff7180cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.825+0000 7ff71e600640 1 -- 172.21.15.100:0/4046997144 >> 172.21.15.100:0/4046997144 conn(0x7ff7180d3a40 msgr2=0x7ff7180d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.825+0000 7ff71e600640 1 -- 172.21.15.100:0/4046997144 shutdown_connections 2024-09-10T21:07:46.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.825+0000 7ff71e600640 1 -- 172.21.15.100:0/4046997144 wait complete. 2024-09-10T21:07:46.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.826+0000 7ff71e600640 1 Processor -- start 2024-09-10T21:07:46.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.826+0000 7ff71e600640 1 -- start start 2024-09-10T21:07:46.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.827+0000 7ff71e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d4560 0x7ff71815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.827+0000 7ff71e600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff71815db30 0x7ff7181f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.827+0000 7ff71e600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7181f8940 0x7ff7180cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.827+0000 7ff71e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180d08b0 con 0x7ff7180d4560 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.827+0000 7ff71e600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180d0730 con 0x7ff7181f8940 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.827+0000 7ff71e600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff7180d0a30 con 0x7ff71815db30 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.827+0000 7ff71d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d4560 0x7ff71815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.827+0000 7ff71d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d4560 0x7ff71815d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41928/0 (socket says 172.21.15.100:41928) 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71d200640 1 -- 172.21.15.100:0/3538372990 learned_addr learned my addr 172.21.15.100:0/3538372990 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff70fe00640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff71815db30 0x7ff7181f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71dc00640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7181f8940 0x7ff7180cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71d200640 1 -- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff71815db30 msgr2=0x7ff7181f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71d200640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff71815db30 0x7ff7181f4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71d200640 1 -- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7181f8940 msgr2=0x7ff7180cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:46.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71d200640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7181f8940 0x7ff7180cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71d200640 1 -- 172.21.15.100:0/3538372990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7181f8dd0 con 0x7ff7180d4560 2024-09-10T21:07:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71dc00640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7181f8940 0x7ff7180cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71d200640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d4560 0x7ff71815d0f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff70800e7c0 tx=0x7ff70800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff715600640 1 -- 172.21.15.100:0/3538372990 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70800ccc0 con 0x7ff7180d4560 2024-09-10T21:07:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff715600640 1 -- 172.21.15.100:0/3538372990 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff708010430 con 0x7ff7180d4560 2024-09-10T21:07:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff715600640 1 -- 172.21.15.100:0/3538372990 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708010860 con 0x7ff7180d4560 2024-09-10T21:07:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.828+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7181f5020 con 0x7ff7180d4560 2024-09-10T21:07:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.829+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7181f55e0 con 0x7ff7180d4560 2024-09-10T21:07:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.830+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7180b99c0 con 0x7ff7180d4560 2024-09-10T21:07:46.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.831+0000 7ff715600640 1 -- 172.21.15.100:0/3538372990 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff708010a00 con 0x7ff7180d4560 2024-09-10T21:07:46.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.832+0000 7ff715600640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff6f4077fa0 0x7ff6f407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:46.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.832+0000 7ff715600640 1 -- 172.21.15.100:0/3538372990 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7ff70809a620 con 0x7ff7180d4560 2024-09-10T21:07:46.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.832+0000 7ff70fe00640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff6f4077fa0 0x7ff6f407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:46.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.833+0000 7ff70fe00640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff6f4077fa0 0x7ff6f407a460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff700033000 tx=0x7ff700004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:46.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:46.836+0000 7ff715600640 1 -- 172.21.15.100:0/3538372990 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff7080631f0 con 0x7ff7180d4560 2024-09-10T21:07:47.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.016+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff7180caaf0 con 0x7ff6f4077fa0 2024-09-10T21:07:47.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.017+0000 7ff715600640 1 -- 172.21.15.100:0/3538372990 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff7180caaf0 con 0x7ff6f4077fa0 2024-09-10T21:07:47.022 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T21:07:47.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff6f4077fa0 msgr2=0x7ff6f407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff6f4077fa0 0x7ff6f407a460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff700033000 tx=0x7ff700004730 comp rx=0 tx=0).stop 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d4560 msgr2=0x7ff71815d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d4560 0x7ff71815d0f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff70800e7c0 tx=0x7ff70800ec80 comp rx=0 tx=0).stop 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 shutdown_connections 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ff6f4077fa0 0x7ff6f407a460 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7181f8940 0x7ff7180cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff71815db30 0x7ff7181f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 --2- 172.21.15.100:0/3538372990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7180d4560 0x7ff71815d0f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.019+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 >> 172.21.15.100:0/3538372990 conn(0x7ff7180d3a40 msgr2=0x7ff7180b5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.020+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 shutdown_connections 2024-09-10T21:07:47.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.020+0000 7ff71e600640 1 -- 172.21.15.100:0/3538372990 wait complete. 2024-09-10T21:07:47.041 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T21:07:47.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T21:07:47.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.199+0000 7f13a6200640 1 -- 172.21.15.100:0/2009465225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1388003a70 msgr2=0x7f1388003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.199+0000 7f13a6200640 1 --2- 172.21.15.100:0/2009465225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1388003a70 0x7f1388003e90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1394001eb0 tx=0x7f1388005830 comp rx=0 tx=0).stop 2024-09-10T21:07:47.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.199+0000 7f13a5800640 1 -- 172.21.15.100:0/2009465225 reap_dead start 2024-09-10T21:07:47.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.199+0000 7f13a6200640 1 -- 172.21.15.100:0/2009465225 shutdown_connections 2024-09-10T21:07:47.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.199+0000 7f13a6200640 1 -- 172.21.15.100:0/2009465225 >> 172.21.15.100:0/2009465225 conn(0x7f13a006d500 msgr2=0x7f13a00b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:47.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.199+0000 7f13a6200640 1 -- 172.21.15.100:0/2009465225 shutdown_connections 2024-09-10T21:07:47.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.199+0000 7f13a6200640 1 -- 172.21.15.100:0/2009465225 wait complete. 2024-09-10T21:07:47.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.200+0000 7f13a6200640 1 Processor -- start 2024-09-10T21:07:47.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.201+0000 7f13a6200640 1 -- start start 2024-09-10T21:07:47.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.201+0000 7f13a6200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1388003a70 0x7f13a006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.201+0000 7f13a6200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a0141e90 0x7f13a0142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.201+0000 7f13a6200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13a01f2310 0x7f13a01f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a6200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13a015c060 con 0x7f1388003a70 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a6200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13a015bee0 con 0x7f13a0141e90 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a6200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f13a015fe30 con 0x7f13a01f2310 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1388003a70 0x7f13a006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1388003a70 0x7f13a006fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41936/0 (socket says 172.21.15.100:41936) 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 -- 172.21.15.100:0/948672608 learned_addr learned my addr 172.21.15.100:0/948672608 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a5800640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13a01f2310 0x7f13a01f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f139fe00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a0141e90 0x7f13a0142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 -- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13a01f2310 msgr2=0x7f13a01f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13a01f2310 0x7f13a01f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 -- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a0141e90 msgr2=0x7f13a0142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a0141e90 0x7f13a0142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 -- 172.21.15.100:0/948672608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a01f3380 con 0x7f1388003a70 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a5800640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13a01f2310 0x7f13a01f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f139fe00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a0141e90 0x7f13a0142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.202+0000 7f13a4e00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1388003a70 0x7f13a006fc30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f139400c3d0 tx=0x7f1394006c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.203+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394031040 con 0x7f1388003a70 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.203+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13940035f0 con 0x7f1388003a70 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.203+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a01f3660 con 0x7f1388003a70 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.203+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394003a40 con 0x7f1388003a70 2024-09-10T21:07:47.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.203+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a01f3c20 con 0x7f1388003a70 2024-09-10T21:07:47.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.204+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13a01f30e0 con 0x7f1388003a70 2024-09-10T21:07:47.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.205+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1394003be0 con 0x7f1388003a70 2024-09-10T21:07:47.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.206+0000 7f139cc00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1380077fa0 0x7f138007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.206+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f13940ba180 con 0x7f1388003a70 2024-09-10T21:07:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.206+0000 7f139cc00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f138007e440 0x7f1380080880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.206+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 --> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f139402ee50 con 0x7f138007e440 2024-09-10T21:07:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.206+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f13940c1050 con 0x7f1388003a70 2024-09-10T21:07:47.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.206+0000 7f139fe00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1380077fa0 0x7f138007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.207+0000 7f13a5800640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f138007e440 0x7f1380080880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.207+0000 7f139fe00640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1380077fa0 0x7f138007a460 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f13a00ae4d0 tx=0x7f138c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.207+0000 7f13a5800640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f138007e440 0x7f1380080880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.208+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 <== osd.5 v2:172.21.15.130:6810/1954625163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f139402ee50 con 0x7f138007e440 2024-09-10T21:07:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.221+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 --> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f13a015f8f0 con 0x7f138007e440 2024-09-10T21:07:47.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f139cc00640 1 -- 172.21.15.100:0/948672608 <== osd.5 v2:172.21.15.130:6810/1954625163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f13a015f8f0 con 0x7f138007e440 2024-09-10T21:07:47.226 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:47.227 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T21:07:47.227 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f138007e440 msgr2=0x7f1380080880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6810/1954625163,v1:172.21.15.130:6811/1954625163] conn(0x7f138007e440 0x7f1380080880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1380077fa0 msgr2=0x7f138007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f1380077fa0 0x7f138007a460 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f13a00ae4d0 tx=0x7f138c005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1388003a70 msgr2=0x7f13a006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 --2- 172.21.15.100:0/948672608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1388003a70 0x7f13a006fc30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f139400c3d0 tx=0x7f1394006c50 comp rx=0 tx=0).stop 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a5800640 1 -- 172.21.15.100:0/948672608 reap_dead start 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 shutdown_connections 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 >> 172.21.15.100:0/948672608 conn(0x7f13a006d500 msgr2=0x7f13a00cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.222+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 shutdown_connections 2024-09-10T21:07:47.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.223+0000 7f13a6200640 1 -- 172.21.15.100:0/948672608 wait complete. 2024-09-10T21:07:47.241 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T21:07:47.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.395+0000 7fb747e00640 1 -- 172.21.15.100:0/2139711404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7480cee00 msgr2=0x7fb74815ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.395+0000 7fb747e00640 1 --2- 172.21.15.100:0/2139711404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7480cee00 0x7fb74815ff30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb7480b2c90 tx=0x7fb74002a8b0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.396+0000 7fb747e00640 1 -- 172.21.15.100:0/2139711404 shutdown_connections 2024-09-10T21:07:47.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.396+0000 7fb747e00640 1 --2- 172.21.15.100:0/2139711404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7480cee00 0x7fb74815ff30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.396+0000 7fb747e00640 1 --2- 172.21.15.100:0/2139711404 >> v2:172.21.15.130:3300/0 conn(0x7fb74815b940 0x7fb748070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.396+0000 7fb747e00640 1 -- 172.21.15.100:0/2139711404 >> 172.21.15.100:0/2139711404 conn(0x7fb7480b2200 msgr2=0x7fb7480cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:47.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.396+0000 7fb747e00640 1 -- 172.21.15.100:0/2139711404 shutdown_connections 2024-09-10T21:07:47.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.396+0000 7fb747e00640 1 -- 172.21.15.100:0/2139711404 wait complete. 2024-09-10T21:07:47.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.397+0000 7fb747e00640 1 Processor -- start 2024-09-10T21:07:47.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.397+0000 7fb747e00640 1 -- start start 2024-09-10T21:07:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.398+0000 7fb747e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74806dbf0 0x7fb748157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.398+0000 7fb747e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7480cee00 0x7fb748151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.398+0000 7fb747e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74815b940 0x7fb748155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.398+0000 7fb747e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7480b3b50 con 0x7fb74815b940 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.398+0000 7fb747e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7480b39d0 con 0x7fb74806dbf0 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.398+0000 7fb747e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb7480b3cd0 con 0x7fb7480cee00 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.398+0000 7fb747400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74815b940 0x7fb748155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb747400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74815b940 0x7fb748155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41962/0 (socket says 172.21.15.100:41962) 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb747400640 1 -- 172.21.15.100:0/2818779026 learned_addr learned my addr 172.21.15.100:0/2818779026 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb746a00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74806dbf0 0x7fb748157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb746000640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7480cee00 0x7fb748151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb747400640 1 -- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7480cee00 msgr2=0x7fb748151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb747400640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7480cee00 0x7fb748151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb747400640 1 -- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74806dbf0 msgr2=0x7fb748157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb747400640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74806dbf0 0x7fb748157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb747400640 1 -- 172.21.15.100:0/2818779026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb748157840 con 0x7fb74815b940 2024-09-10T21:07:47.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb746000640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7480cee00 0x7fb748151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb747400640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74815b940 0x7fb748155860 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb74002aea0 tx=0x7fb740031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.399+0000 7fb73ea00640 1 -- 172.21.15.100:0/2818779026 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740040070 con 0x7fb74815b940 2024-09-10T21:07:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.400+0000 7fb73ea00640 1 -- 172.21.15.100:0/2818779026 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb740004040 con 0x7fb74815b940 2024-09-10T21:07:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.400+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb748157ae0 con 0x7fb74815b940 2024-09-10T21:07:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.400+0000 7fb73ea00640 1 -- 172.21.15.100:0/2818779026 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740004470 con 0x7fb74815b940 2024-09-10T21:07:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.400+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7480ca4d0 con 0x7fb74815b940 2024-09-10T21:07:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.401+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7480cf9c0 con 0x7fb74815b940 2024-09-10T21:07:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.402+0000 7fb73ea00640 1 -- 172.21.15.100:0/2818779026 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb740004610 con 0x7fb74815b940 2024-09-10T21:07:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.403+0000 7fb73ea00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb728077f70 0x7fb72807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.403+0000 7fb73ea00640 1 -- 172.21.15.100:0/2818779026 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fb7400bb490 con 0x7fb74815b940 2024-09-10T21:07:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.403+0000 7fb746a00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb728077f70 0x7fb72807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.404+0000 7fb746a00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb728077f70 0x7fb72807a430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb738004590 tx=0x7fb73800b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.407+0000 7fb73ea00640 1 -- 172.21.15.100:0/2818779026 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb7480cf9c0 con 0x7fb74815b940 2024-09-10T21:07:47.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.591+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fb74815a850 con 0x7fb728077f70 2024-09-10T21:07:47.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.592+0000 7fb73ea00640 1 -- 172.21.15.100:0/2818779026 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb74815a850 con 0x7fb728077f70 2024-09-10T21:07:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T21:07:47.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.594+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb728077f70 msgr2=0x7fb72807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.594+0000 7fb747e00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb728077f70 0x7fb72807a430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb738004590 tx=0x7fb73800b390 comp rx=0 tx=0).stop 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.594+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74815b940 msgr2=0x7fb748155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.594+0000 7fb747e00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74815b940 0x7fb748155860 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb74002aea0 tx=0x7fb740031720 comp rx=0 tx=0).stop 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.594+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 shutdown_connections 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.594+0000 7fb747e00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb74815b940 0x7fb748155860 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.594+0000 7fb747e00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7480cee00 0x7fb748151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.595+0000 7fb747e00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb728077f70 0x7fb72807a430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.595+0000 7fb747e00640 1 --2- 172.21.15.100:0/2818779026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74806dbf0 0x7fb748157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.595+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 >> 172.21.15.100:0/2818779026 conn(0x7fb7480b2200 msgr2=0x7fb74806fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.595+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 shutdown_connections 2024-09-10T21:07:47.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.595+0000 7fb747e00640 1 -- 172.21.15.100:0/2818779026 wait complete. 2024-09-10T21:07:47.616 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T21:07:47.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T21:07:47.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.772+0000 7ffb0a400640 1 -- 172.21.15.100:0/3285597678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb0415f8f0 msgr2=0x7ffb0415fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.772+0000 7ffb0a400640 1 --2- 172.21.15.100:0/3285597678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb0415f8f0 0x7ffb0415fd20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffafc005fd0 tx=0x7ffafc02a940 comp rx=0 tx=0).stop 2024-09-10T21:07:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.772+0000 7ffb0a400640 1 -- 172.21.15.100:0/3285597678 shutdown_connections 2024-09-10T21:07:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.772+0000 7ffb0a400640 1 --2- 172.21.15.100:0/3285597678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb0415f8f0 0x7ffb0415fd20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.772+0000 7ffb0a400640 1 -- 172.21.15.100:0/3285597678 >> 172.21.15.100:0/3285597678 conn(0x7ffb0406d500 msgr2=0x7ffb040b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.773+0000 7ffb0a400640 1 -- 172.21.15.100:0/3285597678 shutdown_connections 2024-09-10T21:07:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.773+0000 7ffb0a400640 1 -- 172.21.15.100:0/3285597678 wait complete. 2024-09-10T21:07:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.774+0000 7ffb0a400640 1 Processor -- start 2024-09-10T21:07:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.774+0000 7ffb0a400640 1 -- start start 2024-09-10T21:07:47.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.775+0000 7ffb0a400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb04073610 0x7ffb04151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.775+0000 7ffb0a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb040aea30 0x7ffb041f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.775+0000 7ffb0a400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb0415f8f0 0x7ffb04155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.775+0000 7ffb0a400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffb040cc110 con 0x7ffb040aea30 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.775+0000 7ffb0a400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffb040af060 con 0x7ffb04073610 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.775+0000 7ffb0a400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffb040cc290 con 0x7ffb0415f8f0 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.775+0000 7ffb03e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb040aea30 0x7ffb041f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb03e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb040aea30 0x7ffb041f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41968/0 (socket says 172.21.15.100:41968) 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb03e00640 1 -- 172.21.15.100:0/3767466297 learned_addr learned my addr 172.21.15.100:0/3767466297 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb09a00640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb0415f8f0 0x7ffb04155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb09000640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb04073610 0x7ffb04151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb03e00640 1 -- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb0415f8f0 msgr2=0x7ffb04155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb03e00640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb0415f8f0 0x7ffb04155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb03e00640 1 -- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb04073610 msgr2=0x7ffb04151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb03e00640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb04073610 0x7ffb04151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb03e00640 1 -- 172.21.15.100:0/3767466297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb041f44d0 con 0x7ffb040aea30 2024-09-10T21:07:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb03e00640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb040aea30 0x7ffb041f8350 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000c490 tx=0x7ffaf000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0016020 con 0x7ffb040aea30 2024-09-10T21:07:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.776+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffaf0012940 con 0x7ffb040aea30 2024-09-10T21:07:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.777+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb04152e90 con 0x7ffb040aea30 2024-09-10T21:07:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.777+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0012d90 con 0x7ffb040aea30 2024-09-10T21:07:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.777+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb041f8890 con 0x7ffb040aea30 2024-09-10T21:07:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.777+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb040cc780 con 0x7ffb040aea30 2024-09-10T21:07:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.779+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffaf001a3b0 con 0x7ffb040aea30 2024-09-10T21:07:47.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.780+0000 7ffb00c00640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffae4077f70 0x7ffae407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.780+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7ffaf00999b0 con 0x7ffb040aea30 2024-09-10T21:07:47.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.780+0000 7ffb00c00640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7ffae407e410 0x7ffae4080850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.780+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 --> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffae4080f20 con 0x7ffae407e410 2024-09-10T21:07:47.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.780+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ffaf009e2a0 con 0x7ffb040aea30 2024-09-10T21:07:47.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.780+0000 7ffb09000640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffae4077f70 0x7ffae407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.780+0000 7ffb09a00640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7ffae407e410 0x7ffae4080850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.781+0000 7ffb09000640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffae4077f70 0x7ffae407a430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40016b0 tx=0x7ffaf4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.781+0000 7ffb09a00640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7ffae407e410 0x7ffae4080850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.782+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 <== osd.6 v2:172.21.15.130:6826/819652068 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffae4080f20 con 0x7ffae407e410 2024-09-10T21:07:47.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.795+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 --> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb041f4980 con 0x7ffae407e410 2024-09-10T21:07:47.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.796+0000 7ffb00c00640 1 -- 172.21.15.100:0/3767466297 <== osd.6 v2:172.21.15.130:6826/819652068 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb041f4980 con 0x7ffae407e410 2024-09-10T21:07:47.801 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:47.801 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T21:07:47.801 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7ffae407e410 msgr2=0x7ffae4080850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6826/819652068,v1:172.21.15.130:6827/819652068] conn(0x7ffae407e410 0x7ffae4080850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffae4077f70 msgr2=0x7ffae407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7ffae4077f70 0x7ffae407a430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40016b0 tx=0x7ffaf4009040 comp rx=0 tx=0).stop 2024-09-10T21:07:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb040aea30 msgr2=0x7ffb041f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 --2- 172.21.15.100:0/3767466297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb040aea30 0x7ffb041f8350 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000c490 tx=0x7ffaf000c950 comp rx=0 tx=0).stop 2024-09-10T21:07:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb09a00640 1 -- 172.21.15.100:0/3767466297 reap_dead start 2024-09-10T21:07:47.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 shutdown_connections 2024-09-10T21:07:47.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 >> 172.21.15.100:0/3767466297 conn(0x7ffb0406d500 msgr2=0x7ffb0406f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:47.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 shutdown_connections 2024-09-10T21:07:47.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.797+0000 7ffb0a400640 1 -- 172.21.15.100:0/3767466297 wait complete. 2024-09-10T21:07:47.816 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T21:07:47.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.970+0000 7fb840400640 1 -- 172.21.15.100:0/876964278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb820003a00 msgr2=0x7fb820003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.970+0000 7fb840400640 1 --2- 172.21.15.100:0/876964278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb820003a00 0x7fb820003e20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009ed0 tx=0x7fb820005830 comp rx=0 tx=0).stop 2024-09-10T21:07:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.970+0000 7fb83e400640 1 -- 172.21.15.100:0/876964278 reap_dead start 2024-09-10T21:07:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.970+0000 7fb840400640 1 -- 172.21.15.100:0/876964278 shutdown_connections 2024-09-10T21:07:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.970+0000 7fb840400640 1 -- 172.21.15.100:0/876964278 >> 172.21.15.100:0/876964278 conn(0x7fb83806cb50 msgr2=0x7fb83806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.971+0000 7fb840400640 1 -- 172.21.15.100:0/876964278 shutdown_connections 2024-09-10T21:07:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.971+0000 7fb840400640 1 -- 172.21.15.100:0/876964278 wait complete. 2024-09-10T21:07:47.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.972+0000 7fb840400640 1 Processor -- start 2024-09-10T21:07:47.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.972+0000 7fb840400640 1 -- start start 2024-09-10T21:07:47.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.973+0000 7fb840400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb820003a00 0x7fb8381f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.973+0000 7fb840400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb838158b70 0x7fb8380cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.973+0000 7fb840400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838153c80 0x7fb838154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.973+0000 7fb840400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb83815f860 con 0x7fb838153c80 2024-09-10T21:07:47.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.973+0000 7fb840400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb83815f6e0 con 0x7fb820003a00 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.973+0000 7fb840400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb83815f9e0 con 0x7fb838158b70 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838153c80 0x7fb838154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838153c80 0x7fb838154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41988/0 (socket says 172.21.15.100:41988) 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 -- 172.21.15.100:0/543850631 learned_addr learned my addr 172.21.15.100:0/543850631 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83d000640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb838158b70 0x7fb8380cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83da00640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb820003a00 0x7fb8381f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 -- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb838158b70 msgr2=0x7fb8380cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb838158b70 0x7fb8380cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 -- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb820003a00 msgr2=0x7fb8381f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb820003a00 0x7fb8381f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 -- 172.21.15.100:0/543850631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8380a9440 con 0x7fb838153c80 2024-09-10T21:07:47.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83da00640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb820003a00 0x7fb8381f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:47.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb83e400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838153c80 0x7fb838154100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb830000f60 tx=0x7fb83000e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb835600640 1 -- 172.21.15.100:0/543850631 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830011870 con 0x7fb838153c80 2024-09-10T21:07:47.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb835600640 1 -- 172.21.15.100:0/543850631 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb830017070 con 0x7fb838153c80 2024-09-10T21:07:47.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.974+0000 7fb835600640 1 -- 172.21.15.100:0/543850631 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830011d40 con 0x7fb838153c80 2024-09-10T21:07:47.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.975+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8381f2e20 con 0x7fb838153c80 2024-09-10T21:07:47.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.975+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8381592d0 con 0x7fb838153c80 2024-09-10T21:07:47.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.976+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8380aac90 con 0x7fb838153c80 2024-09-10T21:07:47.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.977+0000 7fb835600640 1 -- 172.21.15.100:0/543850631 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb83001c460 con 0x7fb838153c80 2024-09-10T21:07:47.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.978+0000 7fb835600640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb818077f70 0x7fb81807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:47.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.978+0000 7fb835600640 1 -- 172.21.15.100:0/543850631 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fb83009a0b0 con 0x7fb838153c80 2024-09-10T21:07:47.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.978+0000 7fb83da00640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb818077f70 0x7fb81807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:47.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.979+0000 7fb83da00640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb818077f70 0x7fb81807a430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb82c035000 tx=0x7fb82c004a40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:47.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:47.981+0000 7fb835600640 1 -- 172.21.15.100:0/543850631 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb8380aac90 con 0x7fb838153c80 2024-09-10T21:07:48.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.164+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb83815ba60 con 0x7fb818077f70 2024-09-10T21:07:48.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.164+0000 7fb835600640 1 -- 172.21.15.100:0/543850631 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb83815ba60 con 0x7fb818077f70 2024-09-10T21:07:48.169 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb818077f70 msgr2=0x7fb81807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb818077f70 0x7fb81807a430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb82c035000 tx=0x7fb82c004a40 comp rx=0 tx=0).stop 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838153c80 msgr2=0x7fb838154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838153c80 0x7fb838154100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb830000f60 tx=0x7fb83000e8c0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 shutdown_connections 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb838153c80 0x7fb838154100 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb838158b70 0x7fb8380cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fb818077f70 0x7fb81807a430 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 --2- 172.21.15.100:0/543850631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb820003a00 0x7fb8381f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 >> 172.21.15.100:0/543850631 conn(0x7fb83806cb50 msgr2=0x7fb83815e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:48.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 shutdown_connections 2024-09-10T21:07:48.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.167+0000 7fb840400640 1 -- 172.21.15.100:0/543850631 wait complete. 2024-09-10T21:07:48.188 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T21:07:48.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T21:07:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.346+0000 7fa2fda00640 1 -- 172.21.15.100:0/1496478764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 msgr2=0x7fa2f815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.346+0000 7fa2fda00640 1 --2- 172.21.15.100:0/1496478764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 0x7fa2f815ba60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009830 tx=0x7fa2e802a480 comp rx=0 tx=0).stop 2024-09-10T21:07:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.346+0000 7fa2fda00640 1 -- 172.21.15.100:0/1496478764 shutdown_connections 2024-09-10T21:07:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.346+0000 7fa2fda00640 1 --2- 172.21.15.100:0/1496478764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2f815c750 0x7fa2f80cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.346+0000 7fa2fda00640 1 --2- 172.21.15.100:0/1496478764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 0x7fa2f815ba60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.346+0000 7fa2fda00640 1 -- 172.21.15.100:0/1496478764 >> 172.21.15.100:0/1496478764 conn(0x7fa2f806cb50 msgr2=0x7fa2f806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.346+0000 7fa2fda00640 1 -- 172.21.15.100:0/1496478764 shutdown_connections 2024-09-10T21:07:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.346+0000 7fa2fda00640 1 -- 172.21.15.100:0/1496478764 wait complete. 2024-09-10T21:07:48.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.347+0000 7fa2fda00640 1 Processor -- start 2024-09-10T21:07:48.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.347+0000 7fa2fda00640 1 -- start start 2024-09-10T21:07:48.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.348+0000 7fa2fda00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f80741e0 0x7fa2f80ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.348+0000 7fa2fda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 0x7fa2f81544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.348+0000 7fa2fda00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2f815c750 0x7fa2f806f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.348+0000 7fa2fda00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80b29e0 con 0x7fa2f815b680 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.348+0000 7fa2fda00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80b2860 con 0x7fa2f80741e0 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.348+0000 7fa2fda00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f80b2b60 con 0x7fa2f815c750 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 0x7fa2f81544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 0x7fa2f81544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42010/0 (socket says 172.21.15.100:42010) 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 -- 172.21.15.100:0/780458102 learned_addr learned my addr 172.21.15.100:0/780458102 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f7400640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2f815c750 0x7fa2f806f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 -- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2f815c750 msgr2=0x7fa2f806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa2f815c750 0x7fa2f806f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 -- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f80741e0 msgr2=0x7fa2f80ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f80741e0 0x7fa2f80ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 -- 172.21.15.100:0/780458102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f806fd80 con 0x7fa2f815b680 2024-09-10T21:07:48.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.349+0000 7fa2f6000640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 0x7fa2f81544f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c450 tx=0x7fa2e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:48.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.350+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4011790 con 0x7fa2f815b680 2024-09-10T21:07:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.350+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2e4017070 con 0x7fa2f815b680 2024-09-10T21:07:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.350+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f8070060 con 0x7fa2f815b680 2024-09-10T21:07:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.350+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4011cc0 con 0x7fa2f815b680 2024-09-10T21:07:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.350+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f8157bc0 con 0x7fa2f815b680 2024-09-10T21:07:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.351+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2f80add90 con 0x7fa2f815b680 2024-09-10T21:07:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.352+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa2e401c460 con 0x7fa2f815b680 2024-09-10T21:07:48.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.353+0000 7fa2eea00640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa2d8077f70 0x7fa2d807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.353+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fa2e4099920 con 0x7fa2f815b680 2024-09-10T21:07:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.353+0000 7fa2eea00640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7fa2d807e410 0x7fa2d8080850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.353+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 --> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2e400ae50 con 0x7fa2d807e410 2024-09-10T21:07:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.353+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa2e409e2a0 con 0x7fa2f815b680 2024-09-10T21:07:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.354+0000 7fa2f6a00640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa2d8077f70 0x7fa2d807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.354+0000 7fa2f7400640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7fa2d807e410 0x7fa2d8080850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.354+0000 7fa2f7400640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7fa2d807e410 0x7fa2d8080850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:48.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.354+0000 7fa2f6a00640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa2d8077f70 0x7fa2d807a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8034000 tx=0x7fa2e80046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:48.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.355+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 <== osd.7 v2:172.21.15.130:6802/351910519 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e400ae50 con 0x7fa2d807e410 2024-09-10T21:07:48.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.368+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 --> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa2f81580a0 con 0x7fa2d807e410 2024-09-10T21:07:48.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.369+0000 7fa2eea00640 1 -- 172.21.15.100:0/780458102 <== osd.7 v2:172.21.15.130:6802/351910519 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa2f81580a0 con 0x7fa2d807e410 2024-09-10T21:07:48.374 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T21:07:48.374 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T21:07:48.374 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.369+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7fa2d807e410 msgr2=0x7fa2d8080850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.369+0000 7fa2fda00640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6802/351910519,v1:172.21.15.130:6803/351910519] conn(0x7fa2d807e410 0x7fa2d8080850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa2d8077f70 msgr2=0x7fa2d807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2fda00640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7fa2d8077f70 0x7fa2d807a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8034000 tx=0x7fa2e80046c0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 msgr2=0x7fa2f81544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2fda00640 1 --2- 172.21.15.100:0/780458102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2f815b680 0x7fa2f81544f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c450 tx=0x7fa2e400c910 comp rx=0 tx=0).stop 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2f7400640 1 -- 172.21.15.100:0/780458102 reap_dead start 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 shutdown_connections 2024-09-10T21:07:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 >> 172.21.15.100:0/780458102 conn(0x7fa2f806cb50 msgr2=0x7fa2f80cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 shutdown_connections 2024-09-10T21:07:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.370+0000 7fa2fda00640 1 -- 172.21.15.100:0/780458102 wait complete. 2024-09-10T21:07:48.388 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T21:07:48.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.541+0000 7f2f21200640 1 -- 172.21.15.100:0/4134977297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f1c15d620 msgr2=0x7f2f1c153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.541+0000 7f2f21200640 1 --2- 172.21.15.100:0/4134977297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f1c15d620 0x7f2f1c153f10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f08005fd0 tx=0x7f2f0802a540 comp rx=0 tx=0).stop 2024-09-10T21:07:48.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.541+0000 7f2f21200640 1 -- 172.21.15.100:0/4134977297 shutdown_connections 2024-09-10T21:07:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.541+0000 7f2f21200640 1 --2- 172.21.15.100:0/4134977297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f1c15d620 0x7f2f1c153f10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.541+0000 7f2f21200640 1 --2- 172.21.15.100:0/4134977297 >> v2:172.21.15.130:3300/0 conn(0x7f2f1c070540 0x7f2f1c0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.541+0000 7f2f21200640 1 -- 172.21.15.100:0/4134977297 >> 172.21.15.100:0/4134977297 conn(0x7f2f1c06cb50 msgr2=0x7f2f1c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.542+0000 7f2f21200640 1 -- 172.21.15.100:0/4134977297 shutdown_connections 2024-09-10T21:07:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.542+0000 7f2f21200640 1 -- 172.21.15.100:0/4134977297 wait complete. 2024-09-10T21:07:48.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.543+0000 7f2f21200640 1 Processor -- start 2024-09-10T21:07:48.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.543+0000 7f2f21200640 1 -- start start 2024-09-10T21:07:48.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f21200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f1c070540 0x7f2f1c1e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f21200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f1c073b80 0x7f2f1c148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f21200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f1c15d620 0x7f2f1c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f21200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c15ac10 con 0x7f2f1c073b80 2024-09-10T21:07:48.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f21200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c15aa90 con 0x7f2f1c070540 2024-09-10T21:07:48.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f21200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c15ad90 con 0x7f2f1c15d620 2024-09-10T21:07:48.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f19400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f1c073b80 0x7f2f1c148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f19e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f1c070540 0x7f2f1c1e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f19400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f1c073b80 0x7f2f1c148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42024/0 (socket says 172.21.15.100:42024) 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.544+0000 7f2f19400640 1 -- 172.21.15.100:0/1914528729 learned_addr learned my addr 172.21.15.100:0/1914528729 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f1a800640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f1c15d620 0x7f2f1c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f19400640 1 -- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f1c15d620 msgr2=0x7f2f1c156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f19400640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f1c15d620 0x7f2f1c156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f19400640 1 -- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f1c070540 msgr2=0x7f2f1c1e3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f19400640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f1c070540 0x7f2f1c1e3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f19400640 1 -- 172.21.15.100:0/1914528729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c154790 con 0x7f2f1c073b80 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f19400640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f1c073b80 0x7f2f1c148410 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f08006010 tx=0x7f2f080038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f12000640 1 -- 172.21.15.100:0/1914528729 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0803e030 con 0x7f2f1c073b80 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f12000640 1 -- 172.21.15.100:0/1914528729 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f08003d90 con 0x7f2f1c073b80 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.545+0000 7f2f12000640 1 -- 172.21.15.100:0/1914528729 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08035040 con 0x7f2f1c073b80 2024-09-10T21:07:48.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.546+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1c154a70 con 0x7f2f1c073b80 2024-09-10T21:07:48.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.546+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1c0b1cd0 con 0x7f2f1c073b80 2024-09-10T21:07:48.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.547+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1c0b4950 con 0x7f2f1c073b80 2024-09-10T21:07:48.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.548+0000 7f2f12000640 1 -- 172.21.15.100:0/1914528729 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2f080049e0 con 0x7f2f1c073b80 2024-09-10T21:07:48.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.549+0000 7f2f12000640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2efc077f70 0x7f2efc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.549+0000 7f2f12000640 1 -- 172.21.15.100:0/1914528729 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f2f080ba440 con 0x7f2f1c073b80 2024-09-10T21:07:48.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.549+0000 7f2f19e00640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2efc077f70 0x7f2efc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.550+0000 7f2f19e00640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2efc077f70 0x7f2efc07a430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00a380 tx=0x7f2f0c010040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:48.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.553+0000 7f2f12000640 1 -- 172.21.15.100:0/1914528729 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2f08082a60 con 0x7f2f1c073b80 2024-09-10T21:07:48.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.737+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f2f1c0aecb0 con 0x7f2efc077f70 2024-09-10T21:07:48.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.738+0000 7f2f12000640 1 -- 172.21.15.100:0/1914528729 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2f1c0aecb0 con 0x7f2efc077f70 2024-09-10T21:07:48.742 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2efc077f70 msgr2=0x7f2efc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2efc077f70 0x7f2efc07a430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00a380 tx=0x7f2f0c010040 comp rx=0 tx=0).stop 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f1c073b80 msgr2=0x7f2f1c148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f1c073b80 0x7f2f1c148410 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f08006010 tx=0x7f2f080038a0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 shutdown_connections 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f1c15d620 0x7f2f1c156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f1c073b80 0x7f2f1c148410 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f2efc077f70 0x7f2efc07a430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 --2- 172.21.15.100:0/1914528729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f1c070540 0x7f2f1c1e3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 >> 172.21.15.100:0/1914528729 conn(0x7f2f1c06cb50 msgr2=0x7f2f1c153220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 shutdown_connections 2024-09-10T21:07:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.740+0000 7f2f21200640 1 -- 172.21.15.100:0/1914528729 wait complete. 2024-09-10T21:07:48.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:07:48.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.913+0000 7f546a000640 1 -- 172.21.15.100:0/3141367509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640cec80 msgr2=0x7f546415bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.913+0000 7f546a000640 1 --2- 172.21.15.100:0/3141367509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640cec80 0x7f546415bcd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54640cc040 tx=0x7f544c02a560 comp rx=0 tx=0).stop 2024-09-10T21:07:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.913+0000 7f546a000640 1 -- 172.21.15.100:0/3141367509 shutdown_connections 2024-09-10T21:07:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.913+0000 7f546a000640 1 --2- 172.21.15.100:0/3141367509 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f546415c210 0x7f546415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.913+0000 7f546a000640 1 --2- 172.21.15.100:0/3141367509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640cec80 0x7f546415bcd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.913+0000 7f546a000640 1 --2- 172.21.15.100:0/3141367509 >> v2:172.21.15.130:3300/0 conn(0x7f54640aea30 0x7f5464073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.913+0000 7f546a000640 1 -- 172.21.15.100:0/3141367509 >> 172.21.15.100:0/3141367509 conn(0x7f546406d500 msgr2=0x7f54640b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.914+0000 7f546a000640 1 -- 172.21.15.100:0/3141367509 shutdown_connections 2024-09-10T21:07:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.914+0000 7f546a000640 1 -- 172.21.15.100:0/3141367509 wait complete. 2024-09-10T21:07:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.915+0000 7f546a000640 1 Processor -- start 2024-09-10T21:07:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.915+0000 7f546a000640 1 -- start start 2024-09-10T21:07:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.916+0000 7f546a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640aea30 0x7f54640cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.916+0000 7f546a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54640cec80 0x7f5464156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.916+0000 7f546a000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f546415c210 0x7f54641568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.916+0000 7f546a000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f546415ffb0 con 0x7f54640aea30 2024-09-10T21:07:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.916+0000 7f546a000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f546415fe30 con 0x7f54640cec80 2024-09-10T21:07:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.916+0000 7f546a000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5464160130 con 0x7f546415c210 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640aea30 0x7f54640cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640aea30 0x7f54640cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42042/0 (socket says 172.21.15.100:42042) 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 -- 172.21.15.100:0/1034478706 learned_addr learned my addr 172.21.15.100:0/1034478706 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5463e00640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54640cec80 0x7f5464156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5469600640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f546415c210 0x7f54641568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 -- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f546415c210 msgr2=0x7f54641568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f546415c210 0x7f54641568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 -- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54640cec80 msgr2=0x7f5464156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54640cec80 0x7f5464156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 -- 172.21.15.100:0/1034478706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5464144f70 con 0x7f54640aea30 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5468c00640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640aea30 0x7f54640cb550 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f545400ead0 tx=0x7f545400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5460c00640 1 -- 172.21.15.100:0/1034478706 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545400cde0 con 0x7f54640aea30 2024-09-10T21:07:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.917+0000 7f5460c00640 1 -- 172.21.15.100:0/1034478706 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5454011470 con 0x7f54640aea30 2024-09-10T21:07:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.918+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54641474f0 con 0x7f54640aea30 2024-09-10T21:07:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.918+0000 7f5460c00640 1 -- 172.21.15.100:0/1034478706 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54540118a0 con 0x7f54640aea30 2024-09-10T21:07:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.918+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5464147ab0 con 0x7f54640aea30 2024-09-10T21:07:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.919+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546415bcd0 con 0x7f54640aea30 2024-09-10T21:07:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.920+0000 7f5460c00640 1 -- 172.21.15.100:0/1034478706 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5454022030 con 0x7f54640aea30 2024-09-10T21:07:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.921+0000 7f5460c00640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5440077f70 0x7f544007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.921+0000 7f5460c00640 1 -- 172.21.15.100:0/1034478706 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f545409a5e0 con 0x7f54640aea30 2024-09-10T21:07:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.922+0000 7f5463e00640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5440077f70 0x7f544007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.922+0000 7f5463e00640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5440077f70 0x7f544007a430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f544c033000 tx=0x7f544c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:48.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:48.925+0000 7f5460c00640 1 -- 172.21.15.100:0/1034478706 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5464144f70 con 0x7f54640aea30 2024-09-10T21:07:49.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.104+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54640b5120 con 0x7f5440077f70 2024-09-10T21:07:49.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.106+0000 7f5460c00640 1 -- 172.21.15.100:0/1034478706 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13362 (secure 0 0 0) 0x7f54640b5120 con 0x7f5440077f70 2024-09-10T21:07:49.110 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:07:49.111 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5440077f70 msgr2=0x7f544007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5440077f70 0x7f544007a430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f544c033000 tx=0x7f544c004730 comp rx=0 tx=0).stop 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640aea30 msgr2=0x7f54640cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640aea30 0x7f54640cb550 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f545400ead0 tx=0x7f545400ef90 comp rx=0 tx=0).stop 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 shutdown_connections 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f546415c210 0x7f54641568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f5440077f70 0x7f544007a430 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54640cec80 0x7f5464156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 --2- 172.21.15.100:0/1034478706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54640aea30 0x7f54640cb550 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 >> 172.21.15.100:0/1034478706 conn(0x7f546406d500 msgr2=0x7f54640ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:49.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 shutdown_connections 2024-09-10T21:07:49.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:07:49.108+0000 7f546a000640 1 -- 172.21.15.100:0/1034478706 wait complete. 2024-09-10T21:07:49.127 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-10T21:07:48.712543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221388,"kb_used_data":5160,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753332,"statfs":{"total":773094113280,"available":772867411968,"internally_reserved":0,"allocated":5283840,"data_stored":2933264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33554432,"num_objects":-8,"num_object_clones":0,"num_object_copies":-16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8,"num_whiteouts":0,"num_read":-9,"num_read_kb":-8192,"num_write":-8,"num_write_kb":-32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002026"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":153,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T21:07:38.965406+0000","last_change":"2024-09-10T21:05:58.754878+0000","last_active":"2024-09-10T21:07:38.965406+0000","last_peered":"2024-09-10T21:07:38.965406+0000","last_clean":"2024-09-10T21:07:38.965406+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:38.965406+0000","last_undegraded":"2024-09-10T21:07:38.965406+0000","last_fullsized":"2024-09-10T21:07:38.965406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:05:57.695966+0000","last_clean_scrub_stamp":"2024-09-10T21:05:57.695966+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:56.658626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1105920,"data_stored":809434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1105920,"data_stored":809434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:07:49.131 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T21:05:57.695966+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=21, tm_min=5, tm_sec=57, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=21, tm_min=7, tm_sec=43, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T21:07:49.131 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T21:08:02.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:08:02.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:08:09.132 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:08:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.297+0000 7faf4fe00640 1 -- 172.21.15.100:0/2217619109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 msgr2=0x7faf500b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.297+0000 7faf4fe00640 1 --2- 172.21.15.100:0/2217619109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 0x7faf500b3970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7faf40005fd0 tx=0x7faf4002a8b0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.297+0000 7faf4fe00640 1 -- 172.21.15.100:0/2217619109 shutdown_connections 2024-09-10T21:08:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.297+0000 7faf4fe00640 1 --2- 172.21.15.100:0/2217619109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 0x7faf500b3970 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.297+0000 7faf4fe00640 1 -- 172.21.15.100:0/2217619109 >> 172.21.15.100:0/2217619109 conn(0x7faf5008d460 msgr2=0x7faf5009cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.297+0000 7faf4fe00640 1 -- 172.21.15.100:0/2217619109 shutdown_connections 2024-09-10T21:08:09.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.297+0000 7faf4fe00640 1 -- 172.21.15.100:0/2217619109 wait complete. 2024-09-10T21:08:09.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.299+0000 7faf4fe00640 1 Processor -- start 2024-09-10T21:08:09.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.299+0000 7faf4fe00640 1 -- start start 2024-09-10T21:08:09.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf500b5c20 0x7faf5014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:09.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf500ce5a0 0x7faf5009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 0x7faf5009f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faf500d07e0 con 0x7faf5015d8a0 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf500cee30 con 0x7faf500ce5a0 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4fe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faf500d0960 con 0x7faf500b5c20 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 0x7faf5009f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4ea00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf500b5c20 0x7faf5014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 0x7faf5009f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40934/0 (socket says 172.21.15.100:40934) 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4f400640 1 -- 172.21.15.100:0/2351476434 learned_addr learned my addr 172.21.15.100:0/2351476434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf46000640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf500ce5a0 0x7faf5009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4f400640 1 -- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf500b5c20 msgr2=0x7faf5014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4f400640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf500b5c20 0x7faf5014fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4f400640 1 -- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf500ce5a0 msgr2=0x7faf5009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4f400640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf500ce5a0 0x7faf5009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.300+0000 7faf4f400640 1 -- 172.21.15.100:0/2351476434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf50150410 con 0x7faf5015d8a0 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.301+0000 7faf4f400640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 0x7faf5009f360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faf4800c410 tx=0x7faf4800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.301+0000 7faf47400640 1 -- 172.21.15.100:0/2351476434 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48011790 con 0x7faf5015d8a0 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.301+0000 7faf47400640 1 -- 172.21.15.100:0/2351476434 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf48017070 con 0x7faf5015d8a0 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.301+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf500a0330 con 0x7faf5015d8a0 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.301+0000 7faf47400640 1 -- 172.21.15.100:0/2351476434 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48011d00 con 0x7faf5015d8a0 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.301+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf500a08f0 con 0x7faf5015d8a0 2024-09-10T21:08:09.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.302+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5015a660 con 0x7faf5015d8a0 2024-09-10T21:08:09.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.303+0000 7faf47400640 1 -- 172.21.15.100:0/2351476434 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faf4801c460 con 0x7faf5015d8a0 2024-09-10T21:08:09.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.304+0000 7faf47400640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7faf2c077f70 0x7faf2c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:09.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.304+0000 7faf47400640 1 -- 172.21.15.100:0/2351476434 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7faf480996a0 con 0x7faf5015d8a0 2024-09-10T21:08:09.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.304+0000 7faf4ea00640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7faf2c077f70 0x7faf2c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:09.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.305+0000 7faf4ea00640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7faf2c077f70 0x7faf2c07a430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf40034000 tx=0x7faf40004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:09.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.308+0000 7faf47400640 1 -- 172.21.15.100:0/2351476434 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faf48021020 con 0x7faf5015d8a0 2024-09-10T21:08:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.488+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 --> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf500b35c0 con 0x7faf2c077f70 2024-09-10T21:08:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.489+0000 7faf47400640 1 -- 172.21.15.100:0/2351476434 <== mgr.4115 v2:172.21.15.130:6800/1902480365 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7faf500b35c0 con 0x7faf2c077f70 2024-09-10T21:08:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:08:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-10T21:08:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7faf2c077f70 msgr2=0x7faf2c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7faf2c077f70 0x7faf2c07a430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf40034000 tx=0x7faf40004ab0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 msgr2=0x7faf5009f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 0x7faf5009f360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faf4800c410 tx=0x7faf4800c8d0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 shutdown_connections 2024-09-10T21:08:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5015d8a0 0x7faf5009f360 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7faf2c077f70 0x7faf2c07a430 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf500ce5a0 0x7faf5009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 --2- 172.21.15.100:0/2351476434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf500b5c20 0x7faf5014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 >> 172.21.15.100:0/2351476434 conn(0x7faf5008d460 msgr2=0x7faf5006ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 shutdown_connections 2024-09-10T21:08:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.492+0000 7faf4fe00640 1 -- 172.21.15.100:0/2351476434 wait complete. 2024-09-10T21:08:09.511 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-10T21:08:08.717024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221384,"kb_used_data":5160,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753336,"statfs":{"total":773094113280,"available":772867416064,"internally_reserved":0,"allocated":5283840,"data_stored":2933264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002641"},"pg_stats":[{"pgid":"1.0","version":"44'74","reported_seq":164,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T21:07:46.255561+0000","last_change":"2024-09-10T21:07:46.255509+0000","last_active":"2024-09-10T21:07:46.255561+0000","last_peered":"2024-09-10T21:07:46.255561+0000","last_clean":"2024-09-10T21:07:46.255561+0000","last_became_active":"2024-09-10T21:05:58.753787+0000","last_became_peered":"2024-09-10T21:05:58.753787+0000","last_unstale":"2024-09-10T21:07:46.255561+0000","last_undegraded":"2024-09-10T21:07:46.255561+0000","last_fullsized":"2024-09-10T21:07:46.255561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'74","last_scrub_stamp":"2024-09-10T21:07:46.255429+0000","last_deep_scrub":"44'74","last_deep_scrub_stamp":"2024-09-10T21:07:46.255429+0000","last_clean_scrub_stamp":"2024-09-10T21:07:46.255429+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:36.908436+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1105920,"data_stored":809434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":219066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1105920,"data_stored":809434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:08:09.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T21:08:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.661+0000 7f0080200640 1 -- 172.21.15.100:0/3367914379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0060003a00 msgr2=0x7f0060003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.661+0000 7f0080200640 1 --2- 172.21.15.100:0/3367914379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0060003a00 0x7f0060003de0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f006c009ed0 tx=0x7f0060005830 comp rx=0 tx=0).stop 2024-09-10T21:08:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.661+0000 7f0080200640 1 -- 172.21.15.100:0/3367914379 shutdown_connections 2024-09-10T21:08:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.661+0000 7f0080200640 1 --2- 172.21.15.100:0/3367914379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0060003a00 0x7f0060003de0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.661+0000 7f0080200640 1 -- 172.21.15.100:0/3367914379 >> 172.21.15.100:0/3367914379 conn(0x7f007806cb50 msgr2=0x7f007806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.661+0000 7f0080200640 1 -- 172.21.15.100:0/3367914379 shutdown_connections 2024-09-10T21:08:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.661+0000 7f0080200640 1 -- 172.21.15.100:0/3367914379 wait complete. 2024-09-10T21:08:09.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.662+0000 7f0080200640 1 Processor -- start 2024-09-10T21:08:09.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.663+0000 7f0080200640 1 -- start start 2024-09-10T21:08:09.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.663+0000 7f0080200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0060003a00 0x7f0078144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:09.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.663+0000 7f0080200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f007814d490 0x7f0078151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.663+0000 7f0080200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f007815a3e0 0x7f007815a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f0080200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f007815f650 con 0x7f007814d490 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f0080200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f007815f4d0 con 0x7f0060003a00 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f0080200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f007815f7d0 con 0x7f007815a3e0 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f007814d490 0x7f0078151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f007814d490 0x7f0078151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40948/0 (socket says 172.21.15.100:40948) 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 -- 172.21.15.100:0/863967861 learned_addr learned my addr 172.21.15.100:0/863967861 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007d800640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0060003a00 0x7f0078144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007e200640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f007815a3e0 0x7f007815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 -- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f007815a3e0 msgr2=0x7f007815a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f007815a3e0 0x7f007815a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 -- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0060003a00 msgr2=0x7f0078144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0060003a00 0x7f0078144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 -- 172.21.15.100:0/863967861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00781590c0 con 0x7f007814d490 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007e200640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f007815a3e0 0x7f007815a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.664+0000 7f007ce00640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f007814d490 0x7f0078151ce0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0064004d90 tx=0x7f0064001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.665+0000 7f0075600640 1 -- 172.21.15.100:0/863967861 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064015020 con 0x7f007814d490 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.665+0000 7f0075600640 1 -- 172.21.15.100:0/863967861 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0064011960 con 0x7f007814d490 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.665+0000 7f0075600640 1 -- 172.21.15.100:0/863967861 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064011db0 con 0x7f007814d490 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.665+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0078151a70 con 0x7f007814d490 2024-09-10T21:08:09.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.665+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0078159620 con 0x7f007814d490 2024-09-10T21:08:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.666+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007815bf40 con 0x7f007814d490 2024-09-10T21:08:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.667+0000 7f0075600640 1 -- 172.21.15.100:0/863967861 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f006401a400 con 0x7f007814d490 2024-09-10T21:08:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.668+0000 7f0075600640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0058077f70 0x7f005807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.668+0000 7f0075600640 1 -- 172.21.15.100:0/863967861 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f006409a920 con 0x7f007814d490 2024-09-10T21:08:09.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.668+0000 7f007d800640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0058077f70 0x7f005807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:09.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.669+0000 7f007d800640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0058077f70 0x7f005807a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f006c035000 tx=0x7f006c004a40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:09.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.672+0000 7f0075600640 1 -- 172.21.15.100:0/863967861 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f006401f020 con 0x7f007814d490 2024-09-10T21:08:09.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.855+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f0078154cf0 con 0x7f007814d490 2024-09-10T21:08:09.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.859+0000 7f0075600640 1 -- 172.21.15.100:0/863967861 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7f00781590c0 con 0x7f007814d490 2024-09-10T21:08:09.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.859+0000 7f0075600640 1 -- 172.21.15.100:0/863967861 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f00640a0080 con 0x7f007814d490 2024-09-10T21:08:09.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0058077f70 msgr2=0x7f005807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0058077f70 0x7f005807a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f006c035000 tx=0x7f006c004a40 comp rx=0 tx=0).stop 2024-09-10T21:08:09.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f007814d490 msgr2=0x7f0078151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:09.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f007814d490 0x7f0078151ce0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0064004d90 tx=0x7f0064001710 comp rx=0 tx=0).stop 2024-09-10T21:08:09.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 shutdown_connections 2024-09-10T21:08:09.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f007815a3e0 0x7f007815a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f007814d490 0x7f0078151ce0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f0058077f70 0x7f005807a430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 --2- 172.21.15.100:0/863967861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0060003a00 0x7f0078144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 >> 172.21.15.100:0/863967861 conn(0x7f007806cb50 msgr2=0x7f007806cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 shutdown_connections 2024-09-10T21:08:09.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:09.861+0000 7f0080200640 1 -- 172.21.15.100:0/863967861 wait complete. 2024-09-10T21:08:09.880 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T21:08:09.881 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T21:08:10.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.033+0000 7f3fad800640 1 -- 172.21.15.100:0/3930472287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c004800 msgr2=0x7f3f8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.034+0000 7f3fad800640 1 --2- 172.21.15.100:0/3930472287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c004800 0x7f3f8c004c80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c310 tx=0x7f3f8c005830 comp rx=0 tx=0).stop 2024-09-10T21:08:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.034+0000 7f3fa7400640 1 -- 172.21.15.100:0/3930472287 reap_dead start 2024-09-10T21:08:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.034+0000 7f3fad800640 1 -- 172.21.15.100:0/3930472287 shutdown_connections 2024-09-10T21:08:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.034+0000 7f3fad800640 1 -- 172.21.15.100:0/3930472287 >> 172.21.15.100:0/3930472287 conn(0x7f3fa806cb50 msgr2=0x7f3fa806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.034+0000 7f3fad800640 1 -- 172.21.15.100:0/3930472287 shutdown_connections 2024-09-10T21:08:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.034+0000 7f3fad800640 1 -- 172.21.15.100:0/3930472287 wait complete. 2024-09-10T21:08:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.035+0000 7f3fad800640 1 Processor -- start 2024-09-10T21:08:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.035+0000 7f3fad800640 1 -- start start 2024-09-10T21:08:10.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.036+0000 7f3fad800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c004800 0x7f3fa81f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:10.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.036+0000 7f3fad800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fa80b1d50 0x7f3fa8153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:10.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.036+0000 7f3fad800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fa815dfb0 0x7f3fa815e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:10.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.036+0000 7f3fad800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815bdf0 con 0x7f3fa815dfb0 2024-09-10T21:08:10.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.036+0000 7f3fad800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815bc70 con 0x7f3f8c004800 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.036+0000 7f3fad800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80b2860 con 0x7f3fa80b1d50 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fa815dfb0 0x7f3fa815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fa815dfb0 0x7f3fa815e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40980/0 (socket says 172.21.15.100:40980) 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 -- 172.21.15.100:0/3715190186 learned_addr learned my addr 172.21.15.100:0/3715190186 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa6a00640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c004800 0x7f3fa81f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa6000640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fa80b1d50 0x7f3fa8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 -- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fa80b1d50 msgr2=0x7f3fa8153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fa80b1d50 0x7f3fa8153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 -- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c004800 msgr2=0x7f3fa81f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c004800 0x7f3fa81f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 -- 172.21.15.100:0/3715190186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa81f4b30 con 0x7f3fa815dfb0 2024-09-10T21:08:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa6000640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fa80b1d50 0x7f3fa8153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:08:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.037+0000 7f3fa7400640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fa815dfb0 0x7f3fa815e440 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80cc700 tx=0x7f3fa0006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.038+0000 7f3f9ea00640 1 -- 172.21.15.100:0/3715190186 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0011900 con 0x7f3fa815dfb0 2024-09-10T21:08:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.038+0000 7f3f9ea00640 1 -- 172.21.15.100:0/3715190186 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f3fa0018070 con 0x7f3fa815dfb0 2024-09-10T21:08:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.038+0000 7f3f9ea00640 1 -- 172.21.15.100:0/3715190186 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00103c0 con 0x7f3fa815dfb0 2024-09-10T21:08:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.038+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa81f4e10 con 0x7f3fa815dfb0 2024-09-10T21:08:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.038+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa81f53d0 con 0x7f3fa815dfb0 2024-09-10T21:08:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.039+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa80cf700 con 0x7f3fa815dfb0 2024-09-10T21:08:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.040+0000 7f3f9ea00640 1 -- 172.21.15.100:0/3715190186 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3fa0010560 con 0x7f3fa815dfb0 2024-09-10T21:08:10.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.041+0000 7f3f9ea00640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3f88077f70 0x7f3f8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:10.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.041+0000 7f3f9ea00640 1 -- 172.21.15.100:0/3715190186 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f3fa009a6f0 con 0x7f3fa815dfb0 2024-09-10T21:08:10.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.042+0000 7f3fa6a00640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3f88077f70 0x7f3f8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.043+0000 7f3fa6a00640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3f88077f70 0x7f3f8807a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3fa815ee70 tx=0x7f3f98005ef0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:10.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.046+0000 7f3f9ea00640 1 -- 172.21.15.100:0/3715190186 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3fa00632c0 con 0x7f3fa815dfb0 2024-09-10T21:08:10.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.260+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fa80b2e80 con 0x7f3fa815dfb0 2024-09-10T21:08:10.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.260+0000 7f3f9ea00640 1 -- 172.21.15.100:0/3715190186 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3923 (secure 0 0 0) 0x7f3fa0062bc0 con 0x7f3fa815dfb0 2024-09-10T21:08:10.265 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T21:08:10.265 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"btime":"2024-09-10T21:07:36:943879+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6834/3760826970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3760826970},{"type":"v1","addr":"172.21.15.100:6834","nonce":3760826970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/2104919496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6835","nonce":2104919496},{"type":"v1","addr":"172.21.15.130:6837","nonce":2104919496}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6836/3102390832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3102390832},{"type":"v1","addr":"172.21.15.130:6836","nonce":3102390832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5034,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2076530872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6833","nonce":2076530872},{"type":"v1","addr":"172.21.15.100:6835","nonce":2076530872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-09-10T21:08:10.265 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-09-10T21:08:10.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3f88077f70 msgr2=0x7f3f8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3f88077f70 0x7f3f8807a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3fa815ee70 tx=0x7f3f98005ef0 comp rx=0 tx=0).stop 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fa815dfb0 msgr2=0x7f3fa815e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fa815dfb0 0x7f3fa815e440 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80cc700 tx=0x7f3fa0006430 comp rx=0 tx=0).stop 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 shutdown_connections 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fa815dfb0 0x7f3fa815e440 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fa80b1d50 0x7f3fa8153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:6800/1902480365,v1:172.21.15.130:6801/1902480365] conn(0x7f3f88077f70 0x7f3f8807a430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 --2- 172.21.15.100:0/3715190186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c004800 0x7f3fa81f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 >> 172.21.15.100:0/3715190186 conn(0x7f3fa806cb50 msgr2=0x7f3fa80cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 shutdown_connections 2024-09-10T21:08:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T21:08:10.263+0000 7f3fad800640 1 -- 172.21.15.100:0/3715190186 wait complete. 2024-09-10T21:08:10.281 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T21:08:10.282 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T21:08:10.282 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T21:08:10.282 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.296 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T21:08:10.296 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T21:08:10.296 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.350 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T21:08:10.351 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T21:08:10.351 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.368 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T21:08:10.368 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T21:08:10.368 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.425 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T21:08:10.426 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T21:08:10.426 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T21:08:10.426 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.481 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T21:08:10.482 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T21:08:10.482 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.538 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T21:08:10.538 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T21:08:10.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.586 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T21:08:10.586 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T21:08:10.587 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.628 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T21:08:10.628 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T21:08:10.628 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.668 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T21:08:10.668 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T21:08:10.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.751 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T21:08:10.751 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T21:08:10.751 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.800 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T21:08:10.800 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T21:08:10.800 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.864 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T21:08:10.864 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T21:08:10.864 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T21:08:10.864 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.927 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T21:08:10.928 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T21:08:10.928 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:10.997 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T21:08:10.997 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T21:08:10.998 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T21:08:10.998 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:11.017 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T21:08:11.018 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T21:08:11.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:11.035 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T21:08:11.035 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T21:08:11.035 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T21:08:11.093 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T21:08:11.094 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T21:08:11.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T21:08:11.175 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:08:11.176 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T21:08:11.429 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:08:11.429 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T21:08:11.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:08:11.592 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T21:08:11.691 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:08:11.692 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T21:08:11.825 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:08:11.825 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T21:08:12.109 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:08:12.110 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T21:08:12.209 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:08:12.209 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T21:08:12.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:08:12.309 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T21:08:12.443 INFO:tasks.ceph:Archiving mon data... 2024-09-10T21:08:12.444 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/data/mon.a.tgz 2024-09-10T21:08:12.444 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-10T21:08:12.480 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.K1Dvv3GtiI 2024-09-10T21:08:12.481 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.K1Dvv3GtiI 2024-09-10T21:08:12.649 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.K1Dvv3GtiI 2024-09-10T21:08:12.742 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.K1Dvv3GtiI is 313KB 2024-09-10T21:08:12.830 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.K1Dvv3GtiI 2024-09-10T21:08:12.865 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/data/mon.b.tgz 2024-09-10T21:08:12.865 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-09-10T21:08:12.901 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.InFeT5GdJ6 2024-09-10T21:08:12.901 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.InFeT5GdJ6 2024-09-10T21:08:13.090 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.InFeT5GdJ6 2024-09-10T21:08:13.183 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.InFeT5GdJ6 is 418KB 2024-09-10T21:08:13.272 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.InFeT5GdJ6 2024-09-10T21:08:13.307 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/data/mon.c.tgz 2024-09-10T21:08:13.307 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-09-10T21:08:13.381 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.k1hZ4V2o0h 2024-09-10T21:08:13.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.k1hZ4V2o0h 2024-09-10T21:08:13.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.k1hZ4V2o0h 2024-09-10T21:08:13.652 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.k1hZ4V2o0h is 418KB 2024-09-10T21:08:13.741 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.k1hZ4V2o0h 2024-09-10T21:08:13.776 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T21:08:13.776 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T21:08:13.781 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T21:08:13.909 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T21:08:13.944 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T21:08:13.944 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T21:08:13.945 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/remote/smithi100/crash 2024-09-10T21:08:13.946 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T21:08:14.004 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/remote/smithi130/crash 2024-09-10T21:08:14.005 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T21:08:14.058 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T21:08:14.058 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:08:14.062 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T21:08:14.156 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T21:08:14.213 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T21:08:14.268 INFO:tasks.ceph:Compressing logs... 2024-09-10T21:08:14.268 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T21:08:14.273 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T21:08:14.323 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T21:08:14.324 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47209.log 2024-09-10T21:08:14.324 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43555.log 2024-09-10T21:08:14.325 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48282.log 2024-09-10T21:08:14.325 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47209.log.gz 2024-09-10T21:08:14.326 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36069.log 2024-09-10T21:08:14.327 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50400.log 2024-09-10T21:08:14.327 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43555.log.gz 2024-09-10T21:08:14.327 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T21:08:14.327 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36069.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T21:08:14.328 INFO:teuthology.orchestra.run.smithi130.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36069.log.gz 2024-09-10T21:08:14.329 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T21:08:14.329 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48282.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48282.log.gz 2024-09-10T21:08:14.329 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42493.log 2024-09-10T21:08:14.329 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44485.log 2024-09-10T21:08:14.329 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50400.log.gz 2024-09-10T21:08:14.330 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35955.log 2024-09-10T21:08:14.330 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42493.log.gz 2024-09-10T21:08:14.331 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36181.log 2024-09-10T21:08:14.331 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44485.log.gz 2024-09-10T21:08:14.331 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35955.log: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.35955.log.gz 2024-09-10T21:08:14.332 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50588.log 2024-09-10T21:08:14.332 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45109.log 2024-09-10T21:08:14.332 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T21:08:14.332 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T21:08:14.332 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35989.log 2024-09-10T21:08:14.334 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36229.log 2024-09-10T21:08:14.334 INFO:teuthology.orchestra.run.smithi130.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T21:08:14.334 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.35989.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35989.log.gz 2024-09-10T21:08:14.334 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36109.log 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36181.log.gz 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51331.log 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50588.log.gz 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42109.log 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45109.log.gz 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51331.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51331.log.gz 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45296.log 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47031.log 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42109.log.gz 2024-09-10T21:08:14.336 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36374.log 2024-09-10T21:08:14.337 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45296.log.gz 2024-09-10T21:08:14.340 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36149.log/var/log/ceph/ceph-client.admin.36229.log: 2024-09-10T21:08:14.340 INFO:teuthology.orchestra.run.smithi130.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36229.log.gz 2024-09-10T21:08:14.340 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36109.log: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41263.log 2024-09-10T21:08:14.340 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36109.log.gz 2024-09-10T21:08:14.341 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36149.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36149.log.gz 2024-09-10T21:08:14.341 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36029.log 2024-09-10T21:08:14.341 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.1.41263.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T21:08:14.341 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36029.log: 88.7% -- replaced with /var/log/ceph/ceph-client.1.41263.log.gz 2024-09-10T21:08:14.341 INFO:teuthology.orchestra.run.smithi130.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36029.log.gz 2024-09-10T21:08:14.341 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47031.log.gz 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36374.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.36374.log.gz 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45888.log 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46726.log 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.45888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.45888.log.gz 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51625.log 2024-09-10T21:08:14.342 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46726.log.gz 2024-09-10T21:08:14.343 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2024-09-10T21:08:14.343 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-09-10T21:08:14.343 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51625.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51625.log.gz 2024-09-10T21:08:14.343 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42239.log 2024-09-10T21:08:14.346 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48790.log 2024-09-10T21:08:14.346 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2024-09-10T21:08:14.346 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45025.log 2024-09-10T21:08:14.346 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42239.log.gz 2024-09-10T21:08:14.346 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46386.log 2024-09-10T21:08:14.346 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48790.log.gz 2024-09-10T21:08:14.346 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48538.log 2024-09-10T21:08:14.346 INFO:teuthology.orchestra.run.smithi100.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45025.log.gz 2024-09-10T21:08:14.347 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T21:08:14.347 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T21:08:14.347 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mds.d.log: gzip -5 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T21:08:14.347 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T21:08:14.347 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41787.log 2024-09-10T21:08:14.349 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.2.46386.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T21:08:14.349 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.2.46386.log.gz 2024-09-10T21:08:14.349 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51919.log 2024-09-10T21:08:14.349 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48538.log.gz 2024-09-10T21:08:14.349 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44493.log 2024-09-10T21:08:14.349 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51919.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51919.log.gz 2024-09-10T21:08:14.349 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50882.log 2024-09-10T21:08:14.350 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44493.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44493.log.gz 2024-09-10T21:08:14.350 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51793.log 2024-09-10T21:08:14.351 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.3.41787.log: 88.1% -- replaced with /var/log/ceph/ceph-client.3.41787.log.gz 2024-09-10T21:08:14.351 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51415.log 2024-09-10T21:08:14.351 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50882.log.gz 2024-09-10T21:08:14.352 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51793.log: gzip -5 87.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.51793.log.gz -- 2024-09-10T21:08:14.352 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.45151.log 2024-09-10T21:08:14.352 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2024-09-10T21:08:14.353 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51415.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.51415.log.gz --verbose 2024-09-10T21:08:14.353 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.49084.log 2024-09-10T21:08:14.353 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45151.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45151.log.gz 2024-09-10T21:08:14.353 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.46936.log 2024-09-10T21:08:14.354 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49084.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2024-09-10T21:08:14.354 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50672.log 2024-09-10T21:08:14.355 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46936.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46936.log.gz 2024-09-10T21:08:14.355 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48324.log 2024-09-10T21:08:14.356 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50672.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50672.log.gz 2024-09-10T21:08:14.356 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46894.log 2024-09-10T21:08:14.357 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48324.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48324.log.gz 2024-09-10T21:08:14.357 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36404.log 2024-09-10T21:08:14.358 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46894.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46894.log.gz 2024-09-10T21:08:14.358 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36376.log 2024-09-10T21:08:14.359 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36269.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz 2024-09-10T21:08:14.359 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T21:08:14.359 INFO:teuthology.orchestra.run.smithi130.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T21:08:14.360 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36404.log: gzip -5 86.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.36404.log.gz 2024-09-10T21:08:14.360 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.43723.log 2024-09-10T21:08:14.360 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36376.log: 86.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.36376.log.gz 2024-09-10T21:08:14.360 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36013.log 2024-09-10T21:08:14.361 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43723.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.43723.log.gz 2024-09-10T21:08:14.361 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49042.log 2024-09-10T21:08:14.362 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36013.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.36013.log.gz 2024-09-10T21:08:14.362 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46810.log 2024-09-10T21:08:14.363 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49042.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49042.log.gz 2024-09-10T21:08:14.363 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44469.log 2024-09-10T21:08:14.363 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36189.log 2024-09-10T21:08:14.364 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.36189.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36189.log.gz 2024-09-10T21:08:14.364 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46810.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46810.log.gz 2024-09-10T21:08:14.364 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49684.log 2024-09-10T21:08:14.365 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45346.log 2024-09-10T21:08:14.365 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44469.log.gz 2024-09-10T21:08:14.365 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49684.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49684.log.gz 2024-09-10T21:08:14.365 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48494.log 2024-09-10T21:08:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51499.log 2024-09-10T21:08:14.366 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45346.log.gz 2024-09-10T21:08:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48494.log: gzip -5 87.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.48494.log.gz -- 2024-09-10T21:08:14.367 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.46532.log 2024-09-10T21:08:14.368 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51499.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.51499.log.gz 2024-09-10T21:08:14.368 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48240.log 2024-09-10T21:08:14.369 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46532.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.46532.log.gz --verbose 2024-09-10T21:08:14.369 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.43153.log 2024-09-10T21:08:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48240.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48240.log.gz 2024-09-10T21:08:14.370 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45235.log 2024-09-10T21:08:14.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2024-09-10T21:08:14.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45235.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45235.log.gz 2024-09-10T21:08:14.372 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52033.log 2024-09-10T21:08:14.372 INFO:teuthology.orchestra.run.smithi100.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.43153.log.gz 2024-09-10T21:08:14.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48110.log 2024-09-10T21:08:14.373 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2024-09-10T21:08:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52033.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52033.log.gz 2024-09-10T21:08:14.374 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2024-09-10T21:08:14.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48110.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48110.log.gz -5 2024-09-10T21:08:14.375 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48002.log 2024-09-10T21:08:14.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47670.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gz 2024-09-10T21:08:14.376 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48450.log 2024-09-10T21:08:14.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47283.log 2024-09-10T21:08:14.377 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48002.log.gz 2024-09-10T21:08:14.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44490.log 2024-09-10T21:08:14.377 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48450.log.gz 2024-09-10T21:08:14.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48197.log 2024-09-10T21:08:14.378 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47283.log.gz 2024-09-10T21:08:14.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44490.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44490.log.gz 2024-09-10T21:08:14.379 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36263.log 2024-09-10T21:08:14.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48197.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.48197.log.gz --verbose 2024-09-10T21:08:14.380 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.44822.log 2024-09-10T21:08:14.381 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.b.log: 91.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T21:08:14.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36263.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36263.log.gz 2024-09-10T21:08:14.382 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48664.log 2024-09-10T21:08:14.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44822.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44822.log.gz 2024-09-10T21:08:14.382 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-09-10T21:08:14.383 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47341.log 2024-09-10T21:08:14.383 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48664.log.gz 2024-09-10T21:08:14.384 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36191.log 2024-09-10T21:08:14.384 INFO:teuthology.orchestra.run.smithi100.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-09-10T21:08:14.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51541.log 2024-09-10T21:08:14.385 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47341.log.gz 2024-09-10T21:08:14.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36191.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36191.log.gz 2024-09-10T21:08:14.386 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43436.log 2024-09-10T21:08:14.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51541.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.47586.log -- replaced with /var/log/ceph/ceph-client.admin.51541.log.gz 2024-09-10T21:08:14.386 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-10T21:08:14.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43436.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43436.log.gz 2024-09-10T21:08:14.387 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50798.log 2024-09-10T21:08:14.388 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47586.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T21:08:14.388 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2024-09-10T21:08:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50798.log: gzip -5 --verbose 87.4% -- -- replaced with /var/log/ceph/ceph-client.admin.50798.log.gz /var/log/ceph/ceph-client.admin.50546.log 2024-09-10T21:08:14.389 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-10T21:08:14.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50630.log 2024-09-10T21:08:14.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50546.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T21:08:14.391 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50546.log.gz 2024-09-10T21:08:14.391 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51163.log 2024-09-10T21:08:14.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50630.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50630.log.gzgzip 2024-09-10T21:08:14.392 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47502.log 2024-09-10T21:08:14.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42727.log 2024-09-10T21:08:14.393 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51163.log.gz 2024-09-10T21:08:14.394 INFO:teuthology.orchestra.run.smithi130.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T21:08:14.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47502.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.47167.log -- replaced with /var/log/ceph/ceph-client.admin.47502.log.gz 2024-09-10T21:08:14.394 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-10T21:08:14.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36852.log 2024-09-10T21:08:14.395 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42727.log.gz 2024-09-10T21:08:14.396 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47167.log: gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz -- 2024-09-10T21:08:14.396 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.44155.log 2024-09-10T21:08:14.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36852.log: gzip 87.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.36852.log.gz --verbose 2024-09-10T21:08:14.397 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.48874.log 2024-09-10T21:08:14.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47089.log 2024-09-10T21:08:14.398 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-09-10T21:08:14.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48874.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.48874.log.gz --verbose 2024-09-10T21:08:14.398 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.44480.log 2024-09-10T21:08:14.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47089.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47089.log.gz 2024-09-10T21:08:14.400 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51961.log 2024-09-10T21:08:14.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44480.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2024-09-10T21:08:14.401 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44828.log 2024-09-10T21:08:14.401 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51961.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.48958.log 2024-09-10T21:08:14.401 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51961.log.gz 2024-09-10T21:08:14.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44828.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44828.log.gz 2024-09-10T21:08:14.402 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43765.log 2024-09-10T21:08:14.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-09-10T21:08:14.403 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2024-09-10T21:08:14.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43765.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43765.log.gz 2024-09-10T21:08:14.404 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51121.log 2024-09-10T21:08:14.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43639.log 2024-09-10T21:08:14.406 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2024-09-10T21:08:14.406 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51121.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51121.log.gz 2024-09-10T21:08:14.406 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36373.log 2024-09-10T21:08:14.407 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49168.log 2024-09-10T21:08:14.407 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43639.log.gz 2024-09-10T21:08:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36373.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36373.log.gz 2024-09-10T21:08:14.408 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48580.log 2024-09-10T21:08:14.409 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2024-09-10T21:08:14.410 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48580.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49168.log.gz 2024-09-10T21:08:14.410 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2024-09-10T21:08:14.411 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48580.log.gz 2024-09-10T21:08:14.411 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42577.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T21:08:14.411 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2024-09-10T21:08:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36419.log 2024-09-10T21:08:14.412 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2024-09-10T21:08:14.413 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44820.log 2024-09-10T21:08:14.414 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36947.log 2024-09-10T21:08:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36419.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T21:08:14.415 INFO:teuthology.orchestra.run.smithi100.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36419.log.gz 2024-09-10T21:08:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44820.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44820.log.gz 2024-09-10T21:08:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2024-09-10T21:08:14.416 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51751.log 2024-09-10T21:08:14.417 INFO:teuthology.orchestra.run.smithi100.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36947.log.gz 2024-09-10T21:08:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51373.log 2024-09-10T21:08:14.417 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz 2024-09-10T21:08:14.418 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44472.log 2024-09-10T21:08:14.418 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51751.log.gz 2024-09-10T21:08:14.419 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51373.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51373.log.gzgzip 2024-09-10T21:08:14.419 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46684.log 2024-09-10T21:08:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2024-09-10T21:08:14.420 INFO:teuthology.orchestra.run.smithi100.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44472.log.gz 2024-09-10T21:08:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46684.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46684.log.gz 2024-09-10T21:08:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49234.log 2024-09-10T21:08:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52115.log 2024-09-10T21:08:14.422 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2024-09-10T21:08:14.423 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49234.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49234.log.gz 2024-09-10T21:08:14.423 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43807.log 2024-09-10T21:08:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51667.log 2024-09-10T21:08:14.424 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52115.log.gz 2024-09-10T21:08:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43807.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43807.log.gz 2024-09-10T21:08:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50097.log 2024-09-10T21:08:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49512.log 2024-09-10T21:08:14.426 INFO:teuthology.orchestra.run.smithi100.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51667.log.gz 2024-09-10T21:08:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.50097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42151.log 2024-09-10T21:08:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.49512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42195.log 2024-09-10T21:08:14.429 INFO:teuthology.orchestra.run.smithi100.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.50097.log.gz 2024-09-10T21:08:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42151.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42151.log.gz 2024-09-10T21:08:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T21:08:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48916.log 2024-09-10T21:08:14.431 INFO:teuthology.orchestra.run.smithi100.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.42195.log.gz 2024-09-10T21:08:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45193.log 2024-09-10T21:08:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50966.log 2024-09-10T21:08:14.433 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48916.log.gz 2024-09-10T21:08:14.434 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51877.log 2024-09-10T21:08:14.435 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45193.log.gz 2024-09-10T21:08:14.435 INFO:teuthology.orchestra.run.smithi130.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T21:08:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44146.log 2024-09-10T21:08:14.436 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50966.log.gz 2024-09-10T21:08:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48408.log 2024-09-10T21:08:14.437 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51877.log.gz 2024-09-10T21:08:14.438 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2024-09-10T21:08:14.438 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44146.log.gz 2024-09-10T21:08:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51205.log 2024-09-10T21:08:14.439 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48408.log.gz 2024-09-10T21:08:14.440 INFO:teuthology.orchestra.run.smithi100.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.0.49512.log.gz 2024-09-10T21:08:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-09-10T21:08:14.440 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gz 2024-09-10T21:08:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29836.log 2024-09-10T21:08:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51205.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51205.log.gz 2024-09-10T21:08:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43933.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-09-10T21:08:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T21:08:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.tmp-client.admin.29836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48748.log 2024-09-10T21:08:14.443 INFO:teuthology.orchestra.run.smithi100.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29836.log.gz 2024-09-10T21:08:14.444 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2024-09-10T21:08:14.445 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43681.log 2024-09-10T21:08:14.445 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48748.log.gz 2024-09-10T21:08:14.447 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45992.log 2024-09-10T21:08:14.447 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2024-09-10T21:08:14.448 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51457.log 2024-09-10T21:08:14.448 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43681.log.gz 2024-09-10T21:08:14.449 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2024-09-10T21:08:14.449 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45992.log.gz 2024-09-10T21:08:14.450 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50503.log 2024-09-10T21:08:14.450 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51457.log.gz 2024-09-10T21:08:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48154.log 2024-09-10T21:08:14.451 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2024-09-10T21:08:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43597.log 2024-09-10T21:08:14.453 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50503.log.gz 2024-09-10T21:08:14.454 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-09-10T21:08:14.454 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48154.log.gz 2024-09-10T21:08:14.454 INFO:teuthology.orchestra.run.smithi130.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T21:08:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44492.log 2024-09-10T21:08:14.455 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43597.log.gz 2024-09-10T21:08:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43975.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T21:08:14.456 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz 2024-09-10T21:08:14.457 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2024-09-10T21:08:14.457 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44492.log.gz 2024-09-10T21:08:14.459 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49126.log 2024-09-10T21:08:14.460 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47754.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz 2024-09-10T21:08:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35869.log 2024-09-10T21:08:14.461 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49126.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49126.log.gz 2024-09-10T21:08:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-09-10T21:08:14.462 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35869.log.gz 2024-09-10T21:08:14.463 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2024-09-10T21:08:14.463 INFO:teuthology.orchestra.run.smithi100.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T21:08:14.464 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42619.log 2024-09-10T21:08:14.464 INFO:teuthology.orchestra.run.smithi100.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-09-10T21:08:14.465 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49819.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T21:08:14.465 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2024-09-10T21:08:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44142.log 2024-09-10T21:08:14.467 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42619.log.gz 2024-09-10T21:08:14.468 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2024-09-10T21:08:14.468 INFO:teuthology.orchestra.run.smithi100.stderr: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T21:08:14.469 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44143.log 2024-09-10T21:08:14.469 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44142.log.gz 2024-09-10T21:08:14.470 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2024-09-10T21:08:14.470 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2024-09-10T21:08:14.471 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36129.log 2024-09-10T21:08:14.471 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44143.log.gz 2024-09-10T21:08:14.472 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44829.log 2024-09-10T21:08:14.473 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2024-09-10T21:08:14.473 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52073.log 2024-09-10T21:08:14.473 INFO:teuthology.orchestra.run.smithi100.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36129.log.gz 2024-09-10T21:08:14.475 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41967.log 2024-09-10T21:08:14.475 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2024-09-10T21:08:14.476 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52073.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.52073.log.gz /var/log/ceph/ceph-client.admin.47838.log 2024-09-10T21:08:14.476 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-10T21:08:14.477 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50840.log 2024-09-10T21:08:14.477 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41967.log.gz 2024-09-10T21:08:14.478 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47460.log 2024-09-10T21:08:14.478 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47838.log.gz 2024-09-10T21:08:14.480 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45067.log 2024-09-10T21:08:14.480 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50840.log.gz 2024-09-10T21:08:14.481 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49742.log 2024-09-10T21:08:14.481 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47460.log.gz 2024-09-10T21:08:14.482 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2024-09-10T21:08:14.482 INFO:teuthology.orchestra.run.smithi100.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45067.log.gz 2024-09-10T21:08:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36414.log 2024-09-10T21:08:14.483 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49742.log.gz 2024-09-10T21:08:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46490.log 2024-09-10T21:08:14.484 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2024-09-10T21:08:14.485 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47544.log 2024-09-10T21:08:14.485 INFO:teuthology.orchestra.run.smithi100.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36414.log.gz 2024-09-10T21:08:14.487 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48366.log 2024-09-10T21:08:14.487 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46490.log.gz 2024-09-10T21:08:14.488 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41471.log 2024-09-10T21:08:14.488 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47544.log.gz 2024-09-10T21:08:14.489 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44827.log 2024-09-10T21:08:14.489 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48366.log.gz 2024-09-10T21:08:14.490 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42067.log 2024-09-10T21:08:14.490 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41471.log.gz 2024-09-10T21:08:14.492 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42661.log 2024-09-10T21:08:14.492 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44827.log.gz 2024-09-10T21:08:14.493 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46852.log 2024-09-10T21:08:14.493 INFO:teuthology.orchestra.run.smithi100.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42067.log.gz 2024-09-10T21:08:14.494 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2024-09-10T21:08:14.494 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42661.log.gz 2024-09-10T21:08:14.495 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36651.log 2024-09-10T21:08:14.495 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46852.log.gz 2024-09-10T21:08:14.496 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51709.log 2024-09-10T21:08:14.496 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2024-09-10T21:08:14.497 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35993.log 2024-09-10T21:08:14.497 INFO:teuthology.orchestra.run.smithi100.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36651.log.gz 2024-09-10T21:08:14.499 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44814.log 2024-09-10T21:08:14.499 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51709.log.gz 2024-09-10T21:08:14.500 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43378.log 2024-09-10T21:08:14.500 INFO:teuthology.orchestra.run.smithi100.stderr: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.35993.log.gz 2024-09-10T21:08:14.501 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42323.log 2024-09-10T21:08:14.501 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44814.log.gz 2024-09-10T21:08:14.502 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43513.log 2024-09-10T21:08:14.502 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43378.log.gz 2024-09-10T21:08:14.503 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50924.log 2024-09-10T21:08:14.504 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42323.log.gz 2024-09-10T21:08:14.504 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51289.log 2024-09-10T21:08:14.504 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43513.log.gz 2024-09-10T21:08:14.506 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44157.log 2024-09-10T21:08:14.506 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50924.log.gz 2024-09-10T21:08:14.507 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44823.log 2024-09-10T21:08:14.507 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51289.log.gz 2024-09-10T21:08:14.508 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47418.log 2024-09-10T21:08:14.508 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44157.log.gz 2024-09-10T21:08:14.510 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43849.log 2024-09-10T21:08:14.510 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44823.log.gz 2024-09-10T21:08:14.510 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51835.log 2024-09-10T21:08:14.511 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47418.log.gz 2024-09-10T21:08:14.512 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36397.log 2024-09-10T21:08:14.512 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43849.log.gz 2024-09-10T21:08:14.513 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48706.log 2024-09-10T21:08:14.513 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51835.log.gz 2024-09-10T21:08:14.514 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2024-09-10T21:08:14.514 INFO:teuthology.orchestra.run.smithi100.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36397.log.gz 2024-09-10T21:08:14.515 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48622.log 2024-09-10T21:08:14.515 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48706.log.gz 2024-09-10T21:08:14.516 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-09-10T21:08:14.517 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2024-09-10T21:08:14.518 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44488.log 2024-09-10T21:08:14.518 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48622.log.gz 2024-09-10T21:08:14.519 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47712.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T21:08:14.519 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-09-10T21:08:14.520 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2024-09-10T21:08:14.520 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44488.log.gz 2024-09-10T21:08:14.521 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46768.log 2024-09-10T21:08:14.523 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36356.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T21:08:14.523 INFO:teuthology.orchestra.run.smithi100.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2024-09-10T21:08:14.524 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46768.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46768.log.gz 2024-09-10T21:08:14.526 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35888.log 2024-09-10T21:08:14.526 INFO:teuthology.orchestra.run.smithi100.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T21:08:14.527 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45478.log 2024-09-10T21:08:14.528 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35888.log.gz 2024-09-10T21:08:14.529 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41871.log 2024-09-10T21:08:14.530 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48832.log 2024-09-10T21:08:14.530 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45478.log.gz 2024-09-10T21:08:14.531 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41871.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41871.log.gz 2024-09-10T21:08:14.531 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44153.log 2024-09-10T21:08:14.532 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 2024-09-10T21:08:14.532 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48832.log.gz 2024-09-10T21:08:14.534 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2024-09-10T21:08:14.534 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44153.log.gz 2024-09-10T21:08:14.535 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50756.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2024-09-10T21:08:14.536 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47628.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2024-09-10T21:08:14.625 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T21:08:15.005 INFO:teuthology.orchestra.run.smithi130.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T21:08:15.053 INFO:teuthology.orchestra.run.smithi130.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T21:08:15.073 INFO:teuthology.orchestra.run.smithi130.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T21:08:15.076 INFO:teuthology.orchestra.run.smithi130.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T21:08:15.079 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-10T21:08:15.079 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m0.775s 2024-09-10T21:08:15.080 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m2.923s 2024-09-10T21:08:15.080 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m0.343s 2024-09-10T21:08:15.085 INFO:teuthology.orchestra.run.smithi100.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T21:08:15.086 INFO:teuthology.orchestra.run.smithi100.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T21:08:15.135 INFO:teuthology.orchestra.run.smithi100.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T21:08:15.261 INFO:teuthology.orchestra.run.smithi100.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T21:08:15.266 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-10T21:08:15.266 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.964s 2024-09-10T21:08:15.266 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m2.957s 2024-09-10T21:08:15.266 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.733s 2024-09-10T21:08:15.266 INFO:tasks.ceph:Archiving logs... 2024-09-10T21:08:15.266 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/remote/smithi100/log 2024-09-10T21:08:15.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T21:08:15.822 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/remote/smithi130/log 2024-09-10T21:08:15.823 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T21:08:16.255 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T21:08:16.263 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T21:08:16.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T21:08:16.268 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T21:08:16.396 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T21:08:16.404 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T21:08:16.404 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:08:16.408 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:08:16.437 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:08:16.442 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:08:16.444 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:08:16.444 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-10T21:08:16.444 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 -454us[ -506us] +/- 36ms 2024-09-10T21:08:16.444 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 +1928us[+1877us] +/- 61ms 2024-09-10T21:08:16.444 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -1214us[-1266us] +/- 65ms 2024-09-10T21:08:16.445 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:08:16.448 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:08:16.448 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-09-10T21:08:16.449 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 -441us[ -490us] +/- 36ms 2024-09-10T21:08:16.449 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 +1902us[+1902us] +/- 61ms 2024-09-10T21:08:16.449 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -1214us[-1214us] +/- 65ms 2024-09-10T21:08:16.449 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:08:16.449 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T21:08:16.458 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T21:08:16.458 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T21:08:16.606 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T21:08:16.727 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T21:08:16.840 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T21:08:16.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:08:16.901 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T21:08:16.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:08:16.960 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T21:08:16.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T21:08:16.986 INFO:teuthology.task.internal:Duration was 599.018869 seconds 2024-09-10T21:08:16.987 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T21:08:16.996 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T21:08:16.997 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T21:08:17.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T21:08:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:08:17.088 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:08:17.460 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T21:08:17.460 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T21:08:17.461 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T21:08:17.510 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-09-10T21:08:17.510 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T21:08:17.570 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T21:08:17.570 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T21:08:17.574 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T21:08:17.632 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T21:08:17.633 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T21:08:17.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T21:08:17.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T21:08:17.790 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T21:08:17.790 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T21:08:17.846 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T21:08:17.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T21:08:17.912 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:08:17.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:08:17.982 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-10T21:08:17.986 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-09-10T21:08:18.016 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:08:18.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:08:18.050 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:08:18.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:08:18.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T21:08:18.093 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T21:08:18.093 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/remote/smithi100 2024-09-10T21:08:18.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T21:08:18.158 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899661/remote/smithi130 2024-09-10T21:08:18.158 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T21:08:18.222 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T21:08:18.222 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T21:08:18.226 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T21:08:18.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T21:08:18.272 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T21:08:18.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T21:08:18.281 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T21:08:18.281 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T21:08:18.302 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T21:08:18.333 INFO:teuthology.orchestra.run.smithi100.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 21:08 /home/ubuntu/cephtest 2024-09-10T21:08:18.336 INFO:teuthology.orchestra.run.smithi130.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 21:08 /home/ubuntu/cephtest 2024-09-10T21:08:18.339 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T21:08:18.349 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T21:08:18.384 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-readahead} duration: 599.0188689231873 flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-10T21:08:18.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T21:08:18.470 INFO:teuthology.run:pass